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Chapter  1 

IBSBOllUCIIQff  mi  OVEHVlEtf 

(Che  hlfltozy  of  cost  overmas  in  the  acquisition 
of  eon^lex  weapon  STStems  indicates  a sigoificsnt  cost 
estimating  pxohlem  within  the  Department  of  Defense  (DoD). 

(Ehis  problem  is  manifested  in  several  ways,  two  of  which 
axe  moat  discouraging.  First,  production  deceleration  or 
posaibljr  termination  is  necessazj  if  additional  funds 
cannot  be  budgeted.  ▲ second,  and  possiblj  worse  mani- 
festation is  the  loss  of  public  trust  and  support  for  the 
DoD  whw  overruns  are  perceived  to  be  the  result  of  waste- 
ful mismanagement.  Given  that  DoD  budget  cutting  is  a 
current  political  theme,  the  DoD  can  ill-afford  any 
avoidable  adverse  publicity.  In  this  context,  the  need 
for  more  accurate  cost  estimating  techniques  is  quite 
clear. 

(Che  ComplexitT  of  Accurate  Cost  Estimation 

Since  cost  estimation  relies  on  forecasting 
future  events  and  trends,  the  entire  process  is  plagued  ] 

with  uncertainty,  i.  common  practice  is  to  identify 
historical  trends  and  project  then  into  the  future. 
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practice  is  reliable  wb.es.  futxxre  trends  are  cossis- 
teat  witb  those  ia  tbe  past.  However,  siace  the  fature 
is  filled  witb  isapredicted  eveats  and  con^lications , 
projectioa  of  past  trends  into  the  fature  oftea  produces 
uxireliable  estimates. 

Ia  aircraft  productioa  many  complezLties  arise 


during  the  life  of  the  productioa  program.  Por  instance , 
it  ia  sometimes  necessary  to  alter  the  programmed  rate  of 
productioa.  in  excerpt  from  a recent  BiHI)  report  pin- 
points tliia  problem: 

Xhe  prime  reqtiirement  for  efficient  production — 
a stable,  fairly  long  production  run — is  usually 
lacking  in  the  airframe  industry.  Flans  are  made 
to  produce  at  one  rate , and  then  because  of  design 
problems,  cost  growth,  funding  problems,  modifica- 
tions, etc.,  the  rate  is  changed.  Decisions  on 
rate  of  out^t  are  based  on  military,  financial, 
and  political  considerations,  not  efficiency  of 
production  C7S8]* 


Limiting  the  Problem 

Daring  initial  contract  negotiations  for  an  air- 
craft production  program,  a tentative  monthly  delivery 
schedule  is  developed  for  the  life  of  the  program. 
However,  formal  contractual  agreements  between  the  DoD 
and  the  contractor  are  usually  limited  to  the  first 
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year's  delivery  requirements.  Delivery  rates  for  subse- 
q:uent  years  are  to  a large  extent  determined  by  the  amount 

2 


ot  program  runds  appropriated  from  jear  to  Tear  br  the 
Cozigreaa  C1.1:2)»  SpeclficallTt  the  fuada  «^ropriated 
mar  'be  more  or  ireaa  them  the  asouat  aeeded  to  oaiatala 
the  dellvezT  schedule  which  was  negotiated  at  the  outset 
or  the  prograiQ.  One  result  of  such  budget  changes  is 
acceleration  or  deceleration  of  the  dellvexT  schedule  for 
the  subsequent  jear*  Since  the  contractor  has  estimated 
his  production  resource  requirements  on  the  tentatire 
production  schedule,  changes  in  that  schedule  will  require 
him  to  evaluate  the  new  requirements  and  their  associated 
costa*  llhe  BoD  iDcuat  similarlT  reevaluate  its  cost  esti- 
mates as  a basis  for  negotiating  contract  revisiozis* 

One  estimate  requiring  revision  involves  the  direct 

labor  requirement  costs  associated  with  fabricating  and 

<1 

assembling  each  airframe  under  the  revised  delivezr 
schedule.  The  traditional  approach  to  estimating  these 
labor  requirements  involves  the  use  of  "learning  cTirve" 
theoiT. 

The  airframe  can  be  viewed  as  an  accounting 
entitr  that  encompaaaea  the  manufacturer's  produc- 
tion responsibilitr.  Tor  example,  airframe  costs 
would  not  include  the  direct  labor  hours  required 
to  produce  engines  and  avionics  but  would  include 
the  hours  required  to  install  those  components. 

In  contrast,  aircraft  costs  would  include  all  the 
costs  associated  with  producing  the  aircraft  [11 : 3] . 


^ I 

Qm  thaoxy  ot  ttia  learnins  curare  in  a popular  foxoi 
•tatM  tliat  "as  tha  total  quazititj  of  units  produced 
dooUss,  tiia  cost  par  unit  daclinas  soma  constant  par-- 
eantaca  VQian.  tlila  theory  is  applied  to  direct 

labor  raqalxamants , tha  term  ''cost'*  in  tlie  abore  defini- 
tion is  cooBonlj  replaced  with,  "direct  labor  man-hours 
par  pound  of  airframe."  Tor  sin^licitj,  this  length^r 
phrase  will  often  be  shortened  to  "labor  hours"  or  "direct 
labor  hours"  in  future  references. 

Althou^  this  traditional  learning  curve  theory 
is  still  widely  used,  it  does  not  systematically  consider 
the  intact  of  anticipated  production  rate  changes  result- 
ing  from  delivery  schedule  revisions.  In  other  words, 
the  impact  of  the  acceleration  or  deceleration  of  learning 
opportunities  that  an  esplicit  production  rate  change 
would  cause  is  not  incorporated  in  the  traditional  theory. 

Concern  over  this  apparent  discrepancy  has  resulted  in 
numerous  approaches  to  incorporate  a production  rate 
factor  in  labor  hour  estimation  formulas. 

%slng  this  enression  as  a pro:^  for  "cost" 
divorces  tlxe  cooqplicating  effects  of  fluctuating  wage 
rates  from  the  estimation  process.  After  labor  hour 
requiremttits  have  been  estimated,  the  e^^ected  hotirly 
wage  rates  can  then  be  used  to  estimate  the  actual 
dollar  costs  (3:5)* 
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Ifoat  of  these  approaches  are  modifications  to  . 
the  traditional  learning  curre  theoxj,  but  none  hatTe 
reoelTed  general  acceptance.  One  reason  that  none  hare 
been  eidel7  accepted  is  probably  beeanse  of  divergent 
research  results  obtained  using  the  various  approaches 
(11:15)*  Boeever,  of  particular  interest  are  the 
research  efforts  from  1969  to  1976  by  Gordon  J.  Johnson 
(6),  Joseph  i..  Orsini  (10),  Joseph  VT.  goah  (8),  and 
Larxy  L.  Smith  (11)  which  yielded  compatible  results. 

Although  each  of  these  individuals  concluded  from 
their  research  that  direct  labor  requirements  were  signif- 
icantly affected  by  production  2»te  clianges,  Smith's 
approach  and  findings  are  the  moat  promising  for  extended 
research.  She  basis  for  this  assertion  is  that  Smith’s 
approach  was  validated  by  analysis  of  histoa^LcciL  produc- 
tion data  from  the  7-4-,  7-102,  and  ZU-135  programs,  and 
as  he  suggested,  "an  obvious  extension  of  this  research 
effort  is  to  duplicate  the  procediire  on  additional  pro- 
grams [11*146]." 

She  Research  Problem  Statement 

Beplication  of  Smith's  labor  liour  estimation 
approach,  uaihg  historical  data  from  different  production 
programs,  is  needed  to  further  validate  his  approach. 
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Heaearch  Ob.leotivea 

Sh»  pxima  objectlTe  is  to  identify  the  intact 
on  direct  labor  requirementa  reaulting^  from  ezteroally 
cauaed  production  rate  changea  in  an  ongoing  production 
prograa*  If  this  prinaxy  ob;)ectlTe  is  accong^liahed,  a 
second  oh(}eetlve  of  farther  validating  i^aith's  approach 
will  he  concurrently  achieved. 


With,  the  problem  narrowed,  and  objectives  outlined 
the  next  chapter  is  devoted  to  a review  of  past  research 
approaches  and  findings.  Chapter  3 discusses  the  research 
hypotheses  and  the  methodology  for  testing  these  hypoth- 
eaes.  Chapter  ^ discusses  the  I-38/7-5  data  and  presents 
the  results  of  analysis  and  hypothesis  testing.  Chapter 
5 summarizes  this  research  effort  with  a discussion  of 
interpretations  axid  concltisions. 
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X 'BZSIQBT  07  LABOT?  BEQUIBEKES!!!  ESIIK4IEI7G  TECBBIQOES 


chaptar  txacea  tha  hiatoxgr  and  darv’alopnieiit 
ot  txaditioauLl  leajpins  eorre  coat  eatiaatine  techniques 
aa  well  aa  the  developaent  ot  four  modif icationa  to  the 
standard  technique.  !I!he  major  eopliasia  is  placed  on 
the  research  efforts  of  Johnson,  Orsini,  ffoah,  and  Smith 
since  their  fisdinga  are  compatible,  and  as  such  fozm  the 
basic  justification  for  this  research.  Smith's  research 
is  given  particular  enphasis,  since  his  method  will  be 


replicated. 


Standard  Le 


Curve  Cost  Kodel 


Kathematical  modeling  of  the  learning  curve  theory 
is  generally  credited  to  T.  F.  Wright  who  published  his 
work  in  1936*  Harold  Asher  reports  that  Wright's  model 
was  ? > iX^,  where: 

T represents  the  cumulative  arerage  direct  man-hours , 

X represents  the  cumulative  number  of  airframes 
produced, 

A represents  the  direct  man-hoxir  cost  of  the  first 
airframe,  and 


. B la  a negative  es^nent  whose  value  reflects  the 
slope'1  of  the  learning-  curve  for  a particular 
production  program 

Asher  further  reports  that  following  World  War 
H,  H«.  Crawford  conducted  studies  of  200  ;]obs  iu  the 
airframe  maxoifactariag  process*  Crawford  concluded 
from  these  studies  that  direct  labor  hours  should  be 
represented  bj  7 • where  t 

7 represents  the  direct  man-hours  for  the  7th  ur^ 
(as  opposed  to  the  cumulative  average),  and 

A,  7,  sad  B have  the  same  meaning  as  defined 
previouslj  (1:21-24-). 

This  second  formulation  is  appropriatel7  called  the  unit 
learning  cxirve  model,  and  will  be  referred  to  as  the 
standard  model  for  the  remainder  of  this  paper. 


Reason  for  Continued  Use 

Althou^  the  standard  model  is  non-linear  in  its 

normal  form,  it  can  be  linearized  through  a logarithmic 

2 

(log)  transformation  where  Log  7 « Log  A B Log  7. 


Xhe  slope  of  the  curve  is  described  in  terms  of 
the  percentage  decrease  in  labor  hours  for  each  doubling 
of  output.  Bor  example,  if  the  labor  reqtiired  to  pro- 
duce the  100th  unit  is  80  percent  of  the  labor  required 
for  the  50th  unit,,  the  slope  of  the  curve  is  80  percent. 
Bor  each  slope,  the  value  of  B is  fixed  (1:17). 

2 

Any  logarithm  "base"  can  be  used  for  the  trans- 
formation. 


8 


!Ehis  traasfoxmatioQ.  la  eaailj  made  "bj  plotting  untxans- 
fozmed  curre  points  on  "log-log"  gxapli  paper.  Tor  perfect 
model  data,  the  eurre  would  Ise  transformed  to  a stnd^t 
line.  This  facilitates  visualization  of  relationships 
within  the  model,  and  permits  rather  single  mathematical 
computation  and  manipulation  These  appealing 

characteristics  hsTe  no  douht  contrihuted  to  the  model's 
widespread  acceptance  and  continued  use. 

Standard  Model  Limitation 

llthoTigh  the  stanxiard  model  is  still  widel7  used, 
it  does  not  systematically  consider  the  is^act  on  direct 
labor  hours  resulting  from  externally  caused  clianges  in 
production  rate.  Concern  over  this  discrepancy  has 
several  intuitive  justifications  as  follows:  (1)  Workers 
would  seemingly  he  motivated  to  work  faster  if  they  sense 
management  pressure  to  increase  production  rate.  The 
reverse  result  also  seems  logical  if  a production  slow- 
doen  is  mandated;  (2)  Task  specialization  seems  more 
likely  as  production  rate  increases  and  additional 
workers  are  hired.  The  reverse  effect  would  be  anticipated 
if  produotion  rate  decreases;  (3)  Machine  set-up  times 
sxid  tooling  costs  can  be  distributed  over  a greater 
number  of  airframes  if  production  rate  is  high  (1:87)> 
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Recogoitioa  of  these  justifications  for  consider- 
ing the  impact  of  production  rate  is  the  DoR  requirement 
for  military  weapon  system  derelopment  programs  to  tie 
production  costs  to  a specific  production  rate  as  early 
as  the  conceptual  phase  of  the  program.  Purtheimorey  the 
military  service  must  consider  the  effect  of  production 
rate  throu^iout  the  various  phases  of  the  acquisition 
process  (7:1). 

The  5-1}  cost  models  of  importance  to  this  research 

are  those  which  modify  the  standard  model  hy  including  a 

second  independent  variable  to  systematically  account  for  . 

• ■ 

production  rate  changes . In  this  context,  the  cost  models 
and  findings  of  Johnson,  Ora  ini,  Roah,  and  Smith  are 
presented. 

Gordon  J.  Johnson.  Johnson  used  the  following  additive 
form  model  to  predict  labor  requirements  for  rocket 
motors;  7 « A -t-  EZ^  -t- 

T represents  the  direct  labor  hours  per  month, 

X|  represents  the . production  rate  in  equivalent 
units  per  month, 

represents  the  cumulative  units  produced  as  of 
^ the  end  of  each  month,  and 

A,  B.  and  C are  coefficients  determined  by  regression, 
and  Z is  assigned  differmt  values  until  an  optimum 
regression  coefficient  of  determination  (R^)  is 
achieved  (6:34-38). 


Development  of  Three-Dimensional  (3-D)  Cost  Models 
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1 


jolmaoxx  reported  tliat  a logical  plsTslcal  interpret 
tatiozL  of  tlie  regression  coefficients  was  not  made.  The 
Z Talne  was  expected  to  approximate  the  negatire  slope 
exponent  for  the  standard  learning  caxrre;  howerer,  the  Z 
value 

...  obtained  in  the  proposed  model  suggests 
a slope  of  the  order  of  20%.  This  is  substantially 
differoLt  frosL  the  usual  improvement  (leazoing 
curve)  slopes  of  about  80%  [6:371 • 

Johnson  attributed  this  un^cpected  value  of  Z to  the  inter- 
action of  the  other  variables  in  Ms  model  wMch  are  not 
found  in  the  standard  model  (6:33). 

The  results  from  regressing  Ms  model  against  the 
four  rocket  motor  data  sets  are  summarized  in  Table  1. 
Johnson  reported  that  an  inadequate  labor  accounting  sys- 
tem, used  by  the  manufacturer  to  goierate  data  set  three, 

Q 

was  the  probable  reason  for  the  low  (.308)  E value.  By 
discounting  the  results  from  data  set  three,  Johnson 
concluded  that  production  rate  is  a significant  determi- 
nant of  direct  labor  requirements  (6:39). 


Josenh  A.  Orsini.  Orsini's  initial  objective  was  to 
determine  the  applicability  of  Johnson's  model  for  air- 
frame production  by  testing  it  against  C-141  production 
data.  The  procedure  employed  was  to  regress  Johnson's 


A 
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BOdttl  in  its  £osiii  and  conpare  rasrilts  with  those 
obtained  uains  a two-dimezisioaal  (.2-Ji)  fora,  of  tha  model 
with  the  pxodoctloxL  rate  variable  omitted  (10:5^77)» 

So  provide  a second  eompariaoa  point,  Orsini 
then  eooverted  Johnson's  model  from  the  additive  form  to 
a mnltiplicative  form.  She  resulting  model  was 

T P where: 

T represents  the  direct  labor  hours  per  quarter, 

X*  represents  the  number  of  units  produced  per 
quarter, 

1^  represents  the  cumulative  units  produced  as  of 
^ the  end  of  each  quarter, 

Bq,  ^2  are  regression  coefficients,  and  e 

is  the  base  of  the  natural  logarithm  S7stem 

(10:66). 

To  facilitate  regression,  this  model  was  transformed  to 
a linear  form  b7  taking  the  natural  logarithm  of  all 
terms  where  In  T • Bq  B^  In  B2  Ln  Z2*  results 

of  regressing  this  model,  and  the  two  forms  of  Johnson's 
model,  are  summarized  in  Table  2. 

The  reason  for  the  differing  values  of  Z pre- 
sented in  Table  2 is  that  Orsini  was  concerned  with  the 
procedure  of  estimating  the  Z value  and  than  treating  it 
as  a constant  during  regression.  Btjr  regressing  the 


standard  model  against  the  C-141  data,  he  determined  that 
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the  actual  leatplng  corre  slope  wets  73  pereexrt.  Since 
use  bigher  for  the  axhitzaril^  chosen  80  percent 
slope  Z Talue  (-*3219)  than  it  was  for  the  actual  73 
percent  slope  Z value  (-.4>329)t  he  questioned  the  worth 
of  including  Z in  the  model  (10:71)* 

Orsini  drew  two  oonolusions  from  the  results 
listed  in  Table  2.  Birst,  the  produotion  rate  variable 
contributes  ia^ortantlj’  to  the  explanatory  power  of  both 
the  additive  and  multiplioative  models.  Second,  he 
concluded  that  the  multiplicative  model  better 
results  because  the  requirement  to  estimate  the  Z value 
is  eliminated  (10:71)* 


Josenh  W.  Josh.  Zoah  studied  the  A.-7  and  7-4  airframe 
production  costs,  and  conducted  an  analysis  of  all  major 
airframe  cost  elements.  Bbwever,  only  the  statistical 
analysis  of  production  rate  effects  on  direct  labor  hotirs 
is  presented  here  (9:4). 

The  model  he  used  is  f our-diaensional , but  since 
it  includes  a production  rate  variable,  it  is  of  interest 
to  this  research.  Bis  model  was  T « where: 

r represents  the  average  direct  labor  hours  per 
pouxid  of  airframe  produced  for  each  airframe  lot, 

X*  represents  the  cumulative  output  expressed  as  j 

po\mds  of  airframe  produced  through  the  midpoint  ] 

of  each  successive  airframe  lot,  ] 
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Zp  i^x^aexLta  the  pxodactioa  rats  tspreased  as  the 
average  pouiida  of  aixfxaae  delivered  per  moath. 
between  the  ilrat  and  last  dellvexT’  o£  the  lot  ^ 

Zx  represoits  the  total  alrfrsme  pottzuis  ordered  for 
^ the  year^ 

e is  the  base  of  the  natural  logarithm,  and 

A>,  B,  C,  and  B are  regressios.  coefficients  C9:33)» 

IToah  used  a log-trazisfoxmed  version  of  his  model 
to  regress  A.-7  esd  data  and  obtained  values  of  .80 
and  .99,  respectively  (9  s 33)*  He  reported  that  statis- 
tical analysis  revealed  the  contribution  of  the  produc- 
tion rate  to  be  significant  in  each  relationship  examined 
(9s^1). 

To  apply  his  model  b^ond  the  A-7  and  7-4>  data, 
he  formulated  a generalized  model  by  averaging  the  regres- 
sion coefficients  (B,  C,  and  D)  obtained  for  the  two  pro- 
grams. Ee  used  this  generalized  model  to  predict  labor 
requirements  for  a follow-on  lot  of  7-14>  airframes  which, 
at  the  time  of  his  report,  were  not  yet  produced  (9:86). 

Since  actual  data  corresponding  to  the  F-14 
predicted  values  were  not  available,  the  accuracy  of  the 
prediction  could  not  be  examined.  Sowever,  the  averaging 
of  regression  coefficients  based  upon  the  analysis  of 
only  two  programs  is  questionable.  This  is  particularly 
so,  since  the  corresponding  coefficients  between  the 
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programs  were  considera'blj  dlfrereat:  21  percent  dlf- 
rexeoice  for  the  B coefficients , 31  percent  for  C coef- 
ficients ^ and  of  the  opposite  algebrsdc  sign  for  D 
coefficients  C9:S6). 


Larry  L.  Smith.  Smith's  objective  was  to  develop  and 
test  a procedure  to  consider  the  effect  of  a production 
rate  change  on  the  direct  production  labor  requirements 
to  produce  additional  airframes  within  the  same  program 
(11:3)*  Se  also  clearly  indicated  that; 

One  purpose  of  this  research  is  to  develop  a 
model  form  and  define  variables  so  that  model 
parameters  can  be  tailored  to  a continuing  air- 
frame production  program*  These  tailored  models 
would  then  be  used  to  predict  the  direct  labor 
costs  of  additional  ai^rames  [11:36]. 

He  further  stated  that  "there  is  no  intent  to  develop  a 
generalized  model,  only  a generalized  approach  to 
building  tailored  cost  models  [11:37]."  Specifically, 
he  wanted  to  develop  a single  cost  model  form  that  could 
be  tailored  to  any  given  program,  but  he  did  not  consider 
a generalization  of  model  coefficients  between  programs 
to  be  appropriate.  Ihrthermore,  within  each  program 
the  coefficients  should  be  updated  as  additional  produc- 
tion data  become  available* 


The  model  Smith  chose  was  a modified  version  of 
Orsini's  multiplicative  model.  The  modified  version  was 


“Sq  • *10  wlieret  . 

Tj  represeata  tlia  tmi-tr  average  direct  labor  hours 
^ required  to  output  each,  potmd  of  airframe  izi 
lot  Lf 

X«£  irapresents  th.e  cumulative  output  of  all  airframes 
^ of  th.e  same  type  through,  lot 

represents  the  lot  1 production  rate  for  all  air- 
^ frames  of  tlxe  same  type,  and 

represents  the  variation^  in  each  dependent 
^ variable  value  that'  is  not  explained  by  the  tvo 
independent  variables,  and 

Bq,  B>|,  B2  are  regression  coefficients 

He  defends  this  model  choice  with,  the  following 

reasons: 

Other  writers  have  suggested  that  it  ni^t  be 
a good  predictor  in  this  aimlication.  Multiple 
regression  analysis  is  facilitated  by  this  choice, 
finally,  investigation  of  some  test  data  indicates 
that  it  works  well  [11 :43]  • 

His  reference  to  facilitating  multiple  regression  stems 
from  the  fact  that  while  the  model  was  curvilinear  in 
its  natural  foim,  it  could  be  linearized  by  taking  the 
logarithm  of  all  terms.  The  res\xlting  transformed  model 


^ is  a statistical  error  term  that  accounts 

for  differences  between  observed  values  and  those  pre- 
dicted by  the  model.  When  the  model  is  used  to  predict 

values  within  or  beyond  the  historical  data,  the  10*^ 
term  is  omitted  from  the  model  (11:4-3  and  4-:23>27)» 
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\mM  Log  « Log  Bq  + Log  + Bg  Log  '•*  *i  * 

Uhoo.  aoqpreased  ijx  this  form,  oultiple  liaear  regresaioa 
was  poaaiBIa  (1^:45 )• 

Vlthla  thla  modal,  Smltli  uaad  two  nathoda  to 

calgolata  a prosQ^  ^or  tha  production  rata  varlabla. 

Sha  rirat  ha  eallad  a "lot  araraga  manufacturing  rata” 

i«hich.  ha  dafinad  aa  tha  nnmbar  of  airframas  in  a lot 

dividad  bj  tha  lot  tima  span*  (She  lot  time  span  is  the 
« 

time  between  the  lot  release  data  for  the  first  airframe 

and  tha  coogtletion  date  for  the  last  airframe*  He 

defined  tha  second  production  rata  pro::g^  as  the  lot 

"delirerj  rate”  which  is  the  actual  monthly  airframe 

acceptance  rate  (11:11-13)* 

As  a means  of  isolating  tha  production  rate's 

contribution  to  tha  esplanatox7  ability  of  the  model, 

he  also  made  use  of  a form  of  the  stazidard  model, 

B*  , . 

^i  “ ®0  • ^i  • 10  ^ , where  the  symbols  hare  tha  same 
meaning  as  in  hia  3-S  modal.  He  referred  to  this  second 
modal  as  tha  ”raducad”  modal,  and  described  his  3-0  modal 
as  a ”full”  modal  (11:69).  Bj  regressing  historical 
production  data  with  each  modal,  and  coi^paring  tha 
statistical  results,  ha  identified  tha  contribution  of 
each  independent  variable. 
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In.  addition,  to  determining  how  well  the  full  and 
reduced  models  fit  the  data,  aiiith.  also  conducted  predict 
tire  abilitT'  tests  for  each  model.  Ihe  procedure  was  to: 
C'T)  omit  a portion,  of  downstream,  data,  (2)  regress  each 
model  againat  the  remaining  data  to  obtain  model  coef- 
I ficients,  (3)  predict  downstream  values  using  the  coef^ 

ficienta  obtained,  and  (4-)  cosrpare  the  predicted  values 
with  the  actual  values  in  the  production  data  (11:36). 

i 

I \ He  did  not  develop  statistical  analysis  for  the  predictive 

ability  tests,  but  instead  used  subjective  analysis.  He 
considered  the  predictive  ability  to  be  good  if  the 
model's  prediction  did  not  deviate  from  observed  values 
by  more  than  an  arbitrarily  chosen  five  percent  (11:96)* 
Furthermore,  since  the  primary  use  for  his  model  was  to 
predict  labor  requirements  as  an  aid  to  negotiating 
contract  revisions  for  a subsequent  year's  production, 
he  was  mainly  concerned  with  each  model's  predictive 
ability  for  one  year  into  the  future.  So,  althou^  he 
tested  each  model's  predictive  ability  for  time  spans 
exceeding  cne  year,  he  was  not  particularly  concerned 
with  results  bej^nd  the  one  year  time  frame  (11:36). 

Vfhen  the  data  provided  hj  the  manufacturers  per- 
mitted, Smith  evaliiated  fabrication  and  assembly  labor 
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liouxs  laj-  aesregating  data  into  fabrication  and  assembl7 
categories.  This  was  possible  with,  the  7-4-  and  EC>135 
data,  bat  not  with,  the  7-^102.  In,  addition,  since  the 
V-4S  throng  airframes  were  significant  modifications 
of  the  7-41  airframe,,  the  data  for  these  different  air> 
frame  types  were  at  times  separated  and  treated  as  two 
production  programs  (11:60,75)- 

In  total.  Smith  set  up  16  test  situations  for 
regression  asalTsis  and  conducted  predictiTe  ability 
testa  for  most  of  these  aituatioia.  Regression  analysis 
and  predictive  ability  test  results  are  summarized  in 
Tables  3 and  4,  respectively.  In  Table  4 the  test 
situations  are  identical  to  those  described  in  Table  3 
and  the  results  presented  are  limited  to  one  year 
predictions. 

The  conclusions  drawn  by  Smith  were  as  follows: 

1.  ^Toduction  rate  was  correlated  negatively 
and  importantly  with  unit  labor  hour  requirements. 

2.  "Lot  average  manufacturing  rate"  gave  better 
results  as  a proxy  for  production  rate  than  did  the 
"delivery  rate."  Sowever,  both  proxies  contributed 
importantly  to  the  full  model's  es^lanatozy  power. 

3-  The  full  model  fit  the  data  better  than  the 

2 

reduced  oiodel,  as  evidenced  by  the  R values. 
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Source I (lit  143) 


Tabl«  4 


ot  Salth.*a  fc«dieti7»  Ability  lasta 


Test 

Situation  # 

% Srror  In  Predicted  Talus 

Phil  Model 

Reduced  Model 

1 

-2.63 

14.5 

2 

2.23 

13.6 

3 

Bbt  Reported 

13.6 

4 

2.24 

5.26 

5 

3.07 

5.26 

6 

-7.84 

Bbt  reported 

7 

Bbt  reported 

8 

-0.67 

1.07 

9 

-4.16 

1.07 

10 

-1.05  • 

5.61 

11 

3.51 

Bot  reported 

12 

4.5 

-3.3 

13 

"b" 

irjjR 

14 

R^R 

15 

»b» 

»b» 

16 

R^R 

R^W 

I 
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^Saith  r«port«d  th«  deriation  was  greater  than  tbat 
for  test  6,  but  did  not  indicate  the  exact  value  (11:9^). 

^Saith  reported  that  not  enou^  data  points  were 
available  for  aeaningful  predictive  ability  tests  (11:131). 

Somce:  (11:71-125).  ^ 
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She  full  model  eai^lained  fabrication  labor 
botir-  variations  more  follj  than  assembly  labor  hour 
variations.. 

5.  She  production  rate  variable  stabilized  and 
is^roved  the  predictive  abilitj  of  the  full  model  for 
the  P-h  and  7-102  programs,  but  tests  for  the  ZC-135 
were  either  impractical  for  lack  of  sufficient  data 
points  or  inconclusive-  for  the  test  si-tniation  containing 
sufficient  data  points. 

6.  Trying  to  formulate  a generalized  cost  model 
from  results  from  the  7-4,  7-102,  and  KC-135  data  should 
not  be  atten^jted  since  the  model  coefficients  varied 
significantly  (11:142-146). 


SnwmwT 


The  main  theme  of  the  literature  re-Tlew  in  this 


chapter  is  that  production  rate  is  an  important  explainer 
of  variations  in  the  direct  labor  hours  required  to  pro- 
duce airframes.  Nore  specifically,  models  containing 
both  cumulative  output  and  production  rate  variables  were 
able  to  ei^lain  more  of  the  variation  in  direct  labor 
requirements  than  models  with  only  a cumulative  output 
variable.  Based  upon  these  findings,  further  Investigation 


of  jpsoductioa  rate  effects  is  jttstified.  la  particular, 
SmitlL's  model  sad  findings  are  worthy  of  furtlier  valida- 
tioa* 


I 
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Chapter  3 

BESEASCE  HEIBOBQLOGT 

This  chapter  outliaes  th.e  procedures  used  and 
research,  hypotheses  tested.  Ercept  for  minor  deviations, 
which  are  discussed  as  they*  arise,,  the  hypotheses  and 
procedures  outlined  are  the  same  as  Smith's.  Eor  ease 
of  reference  the  chapter  is  divided  into  six  ma^jor  sec- 
tions: 

1.  Ohjectives  and  approach, 

2.  Variable  relationships , 

3.  Model  definitions  and  assumptions,  ^ 

Research  hypotheses , 

3.  Data  collection  and  manipulation, 

6.  Summaxy  of  methodology,  assumptions  and 
limitations . 

OBJECTIVES  ABB  ABFBOACH 

The  prime  objective  of  this  study  was  to  identify 
the  ispact  cn  direct  labor  requirements  resulting  from 
externally  caused  production  rate  changes  in  an  ongoing 
production  program.  In  accomplishing  this  objective,  a 
second  objective  of  further  validating  Smith's  model  was 
concurrently  achieved. 
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!I!hA  approach  was  to  collect  historical  prodactioxL 
data  front  the  I-38/7-5  program  aad  evaluate  it  137  replica- 
ting Smith's  approach*  As  in.  his  research,  no  atteispt  was 
made  to  formulate  a generalised,  cost  model.  Zhe  intent 
was  to  evaluate  the  I-58/F-5  production  data  as  a means 
of  tailoring  a labor  hour  prediction  model  to  a specific 
program.  Zherefore,  a comparison  of  regression  coef- 
ficients obtained  for  the  Z-3S/7-5  program  and  those 
obtained  bj  Smith  was  of  casual  interest  onlj.  Zbie  ulti- 
mate value  of  the  tailored  model  was  a function  of  its 
ability  to  predict  labor  requirements  for  production  of 
additional  airframes. 

71BIABLE  RETAZICarsaiPS 

Zhree  airframe  production  variables  and  their 
relationships  were  investigated.  Zhe  variables  were 
assumed  to  be  continuous  and  were  identified  as  follows: 

(1)  direct  labor  man-hours  per  pound  of  airframe  produced, 

(2)  the  cumulative  number  of  airframes  produced,  and  (3) 
the  airframe  production  rate.  Althoueb>  asy  one  of  these 
three  variables  could  be  treated  as  dependent  on  the 
other  two,  direct  labor  man-hours  was  treated  as  the 
dependent  variable.  Zhis  was  reasonable  since  both  the 
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cua^atlTe  output  and  tho  productlou  rate  are  subject  to 
control  tbrougb  contractual  agreement  and  management 
poUcT*. 

The  Labor  Bburs  Tariable 

! 

The  dependent  variable  was  expressed  in  three 
categories:  (1)  total,  (2)  assembly,  and  (3)  fabrication.  \ 

i 

When  expressed  as  total  direct  labor  hours , it  Included 

all  the  hours  req;aired  by  the  contractor  and  major  sub>^ 

contractors  to  fabricate  parts,  assemble  components  from 

the  parts,  assemble  the  airframe  from  the  components  and 

to  install  coaqponents  such  as  avionics  and  engines.  It 

did  not  include  the  labor  to  produce  the  avionics , engines , ^ 

raw  materials,  and  bench  stock  items  such  as  rivets  and 

stazidard  fasteners  (11:38)-  Each  labor  hour  category 

was  subjected  to  regression  analysis  and  predictive 

ability  testa. 

in  important  characteristic  of  the  dependent 
variable  is  that  it  was  ei^ressed  as  a labor  hour  require- 
ment -per  oound  of  airframe.  In  general,  the  total  direct 
labor  hours  required  to  manufacture  an  airframe  will 
increase  as  the  airframe  wei^t  increases.  Since  design 
changes  often  dictate  a change  in  total  airframe  weight , 
this  form  of  the  dependent  variable  was  used  to  systema- 
tically reduce  variations  in  total  labor  requirements. 


la  a noxnal  pxocadxire  wMch.  provides  a eoBBoa  baaie 
Tor  oooqpexizLs  iadaatzT’  aad  govezBueat  eatioatee.  Specific* 

«uy, 

OoresuBeat  and  Xndoatxj  planners  have  agreed 
to  a Sefenae  Contractor  Planning  Report  (SCPR) 
wei^t  that  emlndes  the  Govemnent  fumiahed 
eqnipnent,  fuel  and  luhricanta.  lEhe  OCPR  vei^t 
¥aa  fomerlj  called  the  Airframe  Hanufacturer 
Planning  Report  (iKFR)  wei^t  Z't‘1 , 

Za  this  research  then,  the  dependent  variable  was  actually 

the  unit  average  direct  labor  man-hours  per  IX^  pound 

of  airframe  in  each  lot  produced  (11: A3). 

The  Cnaulative  Outuut  Tariable 

Cumulative  output  is  normally  defined  as  the 
cumulative  number  of  airframes  produced  at  a given  point 
in  production.  However,  when  tiirf names  are  produced  in 
lota,  production  data  are  normally  aggregated  for  the 
entire  lot,  and  actual  data  to  produce  each  airframe 
cannot  be  determined.  Por  this  reason,  the  ciunulative 
output  variable  was  eaq^resaed  as  one-half  the  lot  size 
plus  the  cumulative  number  of  airframes  produced  in 
previous  lots.  This  lot  midpoint  value  was  used  to 
match  a corresponding  lot  average  labor  hour  value  as 
the  dependent  variable  (11:A2). 
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TOXtaiBr,  in.  accoxdanne  with,  established  leaznins 
corrs  thsox7,  the  first  lot  midpoint  was  ad;)u8led  to  allow 
for  the  steep  drop  in.  the  labor  hours  variable  for  the 
first  few  airframes*  She  ed^rzstment  factor  was  attracted 
from  learning  curve  tables  using  the  percent  learning 
slope  determined  bj  regressing  the  standard  model  against 
the  unadjusted  midpoint  data  (2). 


e Production 


Since  production  rate  is  an  abstract  varmble  and 
oot  directly  measurable,  a suitable  pro:^  had  to  be 
developed.  She  construction  of  thia  proay*  depended  upon 
the  format  and  detail  of  production  data  provided  by  the 
manufacturer*  Soth  the  lot  average  manufacturing  rate 
pro37  and  the  delivery  rate  pro:^  developed  by  Smith 
%rere  used  in  this  research  (11:41). 

She  lot  average  manufacturing  rate  was  calculated 
as  the  number  of  airframes  in  a production  lot  divided 
by  the  production  time  span.  The  lot  release  date  of 
the  first  airframe  in  a lot  and  the  completion  date  of 
the  last  airframe  in  the  lot  defined  the  limits  of  the 
production  time  span.  The  lot  release  date  was  defined 
as  the  date  work  orders  were  issued  to  fabricate  the 
first  batch  of  parts  in  a lot.  The  completion  date  was 
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th0  date  the  cust.omer  accepted  the  laat  completed  aircraft 
ia  a lot  b7  aignatuae 

Xhe  lot  dellTezy  rate  waa  calculate  h7  diTidiJUg- 
the  oxa&her  of  alrdframea  in  a lot  bj  the  t^e  apen  crer 
aixsCrasiea  were  delivered  for  that  lot.  Ihia  time 
iiraa  tlie  time  between  acceptance  of  the  firat  and 
iLircraft  in  the  lot.  Conatmctisg  thia  rate  required 
the  number  of  aizframea  in  the  lot  and  the  acceptance 

datea 

HOhEL  BEFDmiOlT  MD  ASSlMPnOBB 

la  discuaaed  in  Chapter  2,  S&ULth  examined  two 
modela  which  he  labeled  aa  the  "reduced  model"  and  the 
"full  model."  Thej  are  reiterated  here  for  eaae  of 
reference. 

Model  Definition 

The  reduced  model  ia  a form  of  the  standard 
learning  curve  model  where: 

^i  - ®o  • ^i  • '•0  • 

She  full  model  includea  a aecond  independent  variable  for 
production  rate  where: 

B>j  Bp  Ci 


CoBBon.  texos  tn  each,  model  iLare  the  same  meaning  and  are 
deacxlhed  as  follows r 
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Zj  xepxeseata  the  imlt  average  direct  labor  hotirs 
^ required  to  output  each  pound  of  airframe  in 
lot  ij 


represents  the  cnmulatire  output  of  all  airframes 
of  the  same  type  throii^  lot  i,. 


2^  represents  the  lot  i production  rate  for  all  air> 
^ frames  of  the  same  type. 


cj  represents  the  variation  in  each  depend^t  variable 
^ value  that  is  not  explained  by  the  two  independent 
variables , and 


Bq,  and  B2  are  regression  coefficients  (11:4-2). 


Model  Evaluation  Assumptions 

Least  squares  oniltiple  linear  regression  was  used 
to  analyze  each  model.  To  facilitate  regression  analysis , 
the  models  were  transformed  to  a linear  form  by  taking 
the  logarithm  of  each  term.  These  transformed  models  are 
also  reiterated.  In  log-linear  form  the  reduced  model 
is 

Log  • Log  Bq  + B^  Log 

and  the  full  model  is  «• 

Log  • Log  B^  4-  B>,  Log  B2  Log  Z2^  4-  . 

To  permit  statistical  significance  testing  on  the 
regression  results,  the  error  terms  in  the  logarithm 
domain  were  assumed  to  be  normally  distributed  with  a 
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neaxi  of  zero  .and  a constant  variance.  Turtlier,  the  error 
tema  were  asauned  to  be  independent  of  each  other  and  of 
the  independent  variables. 

Jl  problea  with  regression  analTsis  in  this 
situation  is  that  mdlti-collinearitj  between  the  two 
indepttsdent  variables  will  probably  occur.  Support  for 
this  possibility  is  taken  from  the  basic  learning  curve 
theory  stated  in  reverse.  Specifically , if  available 
labor  hours  are  held  constant  while  cumulative  output 
increases,  the  rate  of  production  should  increase  because 
each  successive  item  irequires  less  labor  production  time. 

When  high  multi-coUinearity  exists  between 
independent  variables  in  regression  analysis,  the  stan- 
dard error  of  the  estimate  of  the  individual  regression 
coefficients  may  become  unreliably  large  (11:46).  One 
result  of  this  might  be  to  reject  the  significance  of  the 
coefficients  when,  in  fact,  th^  are  significant.  While 
BMlti-collinearity  may  cause  statistical  significance 
teats  to  fail,  the  predictive  ability  of  the  model  may 
not  be  ingpaired.  Since  predictive  ability  is  the  ulti- 
mate test  of  the  model,  the  production  rate's  contribution 
to  the  model  can  still  be  subjectively  evaluated  by  com- 
paring predictioxis , made  with  the  full  and  reduced  models, 
against  each  other  and  against  the  observed  values. 
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BESEABCE  BTFOIEESES 


She  tliree  research.  iQrpothesea  tested  bj  Sttlth 
were  also  tested  in  this  research.  The  first  stated  tMt 
"prodactiozL  rate  is  an  iaq>ortant  explainer  of  Tariation 
in  total  direct  labor  requirements  wh^  included  in  an 
appropriate  model  Ibr  purposes  of  continxiitj. 

Smith's  second  bTpo thesis  was  reworded  as  follows: 
deduction  rate  is  an  is^ortant  explainer  of  variation  in 
direct  fabrication  labor  reqTiirements  and  direct  assembly 
labor  requirements  when  included  in  an  appropriate  oxodel 
(11:47).  His  third  hypothesis  stated  that  "the  predictive 
abilitj  of  each  (full)  model  is  good  for  one  year  into 
the  future  C'>1s56]." 

Research  Hroothesis  One  (11:48-54) 

The  first  research  hypothesis  was  tested  indirectlj 
b7  performing’  statistical  significance  and  subjective 
criteria  teats  on  model  coefficients  determined  b7  regres- 
sion of  historical  airframe  production  data.  The  model 
tested  was  the  full  model  ei^ressed  in  logarithmic  form. 

In  testing  this  hypothesis,  the  dependent  variable 
subjected  to  regression  anal7sis  was  the  logarithm  of 
total  direct  hours  per  pound.  The  independent  variables 
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were  tlie  logaritlims  of  tlie  cumulative  output  at  the  pro- 
ductlozi  lot  midpoint  and  the  production  rate.  Both  of 
tha  defined  forma  of  the  production  rate  were  examined. 


Statiatieal  &rDotheaia  one  (A)  (11:48-^).  This  hypotliesis 
states  that  cumulative  production  and  production  rate  are. 
related  to  hours  per  potnad  as  indicated  in  the  model. 

When  ea^reased  in  null  and  alternate  hypothesis  form  it 
becomes : 

and  B2  > 0 
/ 0 and/or  B2  / 0 . 

The  null  hypothesis  was  rejected  and  the  alternate 
hypothesis  accepted  when  the  test  statistic  F*  was  greater 
than  the  critical  statistic  P.  at  the  0.05  level  of  sig- 

w 

nificance.^  For  this  test^,  F*  » CEV/Cp-I)]  ♦ CUV/(n-p)3 
idiere: 

E7  represents  the  explained  variation  and  is  defined 
as  the  sum  of  the  square  of  differences  between 
logarithms  of  the  predicted  dependent  variable 
values  and  the  mean  of  the  observed  dependent 
variable  values, 


-1 

The  Fc  values  were  extracted  from  an  F-distribu- 
tion  table  (8:807-813). 

0 * 

^Although  Smith  used  different  symbology,  the  F 

calculation  method  used  here  is  equivalent  to  his. 
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U7  represosits  the  uaexplaiaed  variatloii  and  is 
d^lned  aa  the  sua  of  the  squared  differences 
between  logarlthas  of  the  observed  dependent 
-Taxiable  values  and  the  corresponding  predicted 
values, 

n is  the  number  of  observations,  and 

p IS  the  number  of  coefficients  estimated  during 
regression  (4:22)» 

Statistical  hypothesis  one  (B)  (11:49-50),  This  hypoth- 
esis was  formulated  to  test  the  ability  of  the  production 
rate  variable,  when  combined  with  the  cumulative  output 
variable,  to  explain  additional  variation  in  the  direct 
labor  hours.  In  statistical  terms,  this  is  equivalent  to 
stating  that  the  B2  coefficient  has  a non-zero  value  at 
a prespecified  level  of  significance.  The  hypothesis  is 
stated  in  null  and  alternate  form  as  follows: 

H_:  • 0 

o d 

Again,  the  null  hypothesis  was  rejected  when  the  test 

m 

statistic  F was  greater  than  the  critical  statistic  F^ 

at  the  0.05  level  of  significance. 

m 

For  this  test,  F was  calculated  by  determining 
the  increase  in  e^qplained  variation  of  the  dependent 
variable  that  could  be  attributed  to  adding  the  production 
rate  variable  to  the  reduced  model.  Specifically, 
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P » C A BV]  ♦ CW/Ca-p)] , wihicli  is  equivalent  to 
P*  - C(l^  - a|)in  ♦ CW(a-p)],  wliere: 

i£7  represents  tlie  change  in  M^lained  variation 
resulting  from  the  introduction  of  the  loga-> 
rithn.  of  the  production  rate  variable, 

K is  the  coefficient  of  determination  for  the 
^ full  model  and  is  tlie  ratio  of  E7^/TY,  and 

is  the  coefficient  of  determination  for  the 
^ reduced  model  and  equals  EY^yiY  (11:31). 

Criterion  test  (11:50-5^).  Smith  formulated  a third 
statistical  hypothesis  to  evaluate  the  overall  appropriate 
ness  of  the  full  model.  Eowever,  he  did  not  perform 
statistical  aiguificance  tests  to  evaluate  the  hypothesis. 
This  inconsistency  in  methodology  did  not  affect  the 
validity  of  Smith’s  analysis,  but  from  a research  theory 
standpoint,  a criterion  test  was  more  appropriate  than  a 
hypothesis  test.  So,  although  a criterion  test  was  used 
here,  the  method  of  analysis  was  the  same  as  Smith's. 

A.  formal  statement  of  this  criterion  test  is: 

When  the  full  model  ei^lained  more  of  the  variation  in 
direct  labor  hours  than  the  reduced  model , and  when  an 
examination  of  residuals  revealed  that  the  assumptions 
on  error  terms  were  not  violated,  the  model  was  appro- 
priate. More  specifically,  the  model's  appropriateness 
could  not  be  rejected  when;  (1)  the  subjective  testa 


descrilaed  in  the  tollowing  paragraph^  did  not  reread  a 

substantial  departure  from  the  assuizgptions  of  constant 

residual  rardLance,  residual  independence,  and  normal 

distribution  of  residuals;  (2)  the  Br  ralue  for  the, full 

2 

model  was  greater  than  the  £ ralue  for  the  reduced  model. 

The  assumption  that  residual  rariance  is  constant 
was  checked  br  plotting  the  residual  ralues  against  the 
dependCT.t  rariable  ralues  predicted  bj  the  regressed 
model.  When  the  plot  pattexn  rerealed  that  residuals  were 
erenlr  distributed  orer  the  range  of  obserrations , the 
bulk  of  residuals  were  within  one  standard  error  of  the 
estimate,  the  assumption  of  constant  residual  rariance 
was  considered  to  be  ralid 

That  residuals  were  independent  of  each  other  and 
independent  of  the  independent  rariables  was  examined  br 
plotting  residual  ralues  against  each  independent  rariable. 
When  no  crclic  recurrences  or  trends  could  be  identified, 
and  when  the  residuals  fluctuated  randomlr  abore  and  below 
the  line  formed  br  the  predicted  ralues,  the  assumption 
of  independence  was  considered  ralid  (11:51). 


A means  of  checlcias  for  a normal  distri)3ution  of 
residuals  was  to  plot  them  as  a frequaic7  distrihution  on 
normal  probabilitj  paper.  Uhen  the  distrihution  did  not 
deviate  3uh8tantiall7  from  a straight  line,  the  assiunp* 

tioi",  of  noxmalitj  was  considered  to  be  valid  (11:52). 

2 

Brnmi  nation  of  E values  for  the  full  and  reduced 

model  was  appropriate  since  two  forms  of  eid^ted  as  a 

result  of  log-linearizing  the  models  prior  to  performing 

the  regression  analysis . The  two  forms  are  symbolized  as 
2 

follows:  (1)  E^  (log)  for  the  coefficient  of  determina- 
tion of  the  full  model  in  the  logarithm  domain,  and  (2) 
e|  (actual)  for  the  full  model  in  its  natural  form.  E^ 
(log)  and  E^  (actual)  are  similarly  defined  for  the 
reduced  model. 

Evaluation  of  (log)  and  s|  (log)  was  not  made 
since  Statistical  ^jrpothesis  One  (A)  was  equivalent  to 
performing  significance  tests  on  E^  (log)  (A:51).  For 
the  purpose  of  evaluating  the  criterion  test , attention 
was  focused  on  ^ (actual)  and  (actual). 

The  E (actual)  terms  were  determined  by  coasting 
and  comparing  the  regression  model's  prediction  of  each 
actual  direct  labor  hour  value  with  the  actual  observed 
value.  The  £7  and  T7  statistics  were  then  calculated  in 
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the  «*iin>  Banner  as  eacplained  earlier  for  the  logarlthoxc . 
-values*  1!he  resulting  -values  of  ^ Cac-!nial)  and  (ac-tual) 
were  then  con^ared 


. When  the  mill 


hTpothesis  in  Statistical  ^Tpotheses  Cne  (A)  and  (B)  were 
both  reflected,  and  the  conditions  specified  in  the  criterion 
test  were  not  -riolated}  the  full  model  was  accepted  as 
an  appropriate  modification  to  the  reduced  model.  When 
the  model  was  accepted,  it  followed  that  the  production 
rate  contributed  in^ortantly  to  the  ea^lanation  of  varia- 
tion in  total  direct  labor  hours  required  to  produce  an 
airframe. 

Research  HTUothesis  Two  (11:5^55) 

The  only  difference  between  the  first  and  second 
research  hypotheses  was  that  the  terms  direct  fabrication 
labor  recuirements  direct  assembly  labor  requirements 


were  substituted  one  at  a time  for  total  direct  labor 
requirements . Since  this  change  was  accommodated  by 
re-vising  the  model's  dependent  variable  only,  the  same 
statistical  hypotheses  and  criterion  test  used  to  evaluate 
research  hypothesis  one  were  again  applicable. 


Beaearch.  Brpotlieaia  Three  (11:56) 

Sijice  thB  third  reaearch.  hTpotheaia  doea  not  lend 
itaair  to  fonmilatiozL  of  a atatlatical  aubh7poth.eaia , a 
criterion  teat  for  auh;]ectire  anal 73 ia  is  presented. 

Specif icallj,  the  model's  predicti-re  ability  was  accepted 
as  when  the  one  year  predictions  did  not  deviate  from 
obaerred  ralues  by  more  than  five  percent  (11:96). 
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!Ehe  method  for  evaluating  predictive  ability  of 


the  model  was  explained  by  Smith  as  follows: 


In  a real  application  of  the  model,  the  pre- 
diction would  be  beyond  the  range  of  the  historical 
data.  Ihe  only  way  to  teat  the  accuracy  of  the 
prediction  would  be  to  wait  and  see  how  many  hotirs 
it  takes  to  build  the  next  airframe  lot.  lo  aima- 
late  this  situation,  the  regression  coefficients 
in  the  model  are  estimated  with  the  last  few 
observed  data  points  omitted.  Then  using  this  new 
model,  omitted  values  (which  are  knovm  but  not 
used  in  estimating  the  model  coefficients)  are 
predicted.  Comparisons  are  then  draim  between  the 
actual  and  predicted  hours  as  a subjective  measure 
of  predictive  ability  [11:56]. 


DATA  COLCECTIOB 


Since  the  research  approach  was  to  tailor  Smith’s 
full  model  to  a set  of  production  data,  and  not  to 
generalize  the  model  for  all  production  programs,  acces- 
sibility was  the  primary  basis  for  data  selection. 

With  the  exception  of  aircraft  acceptance  dates, 
the  T-38/B-5  data  were  obtained  directly  from  the 

A1 


maBufacturer»  These  dates  were  obtained  from  Aircraft 
Accountability  Becoxds  (A3LC  ibm  1026)  at  Air  Force 
Logistics  Command  Headquarters  (AEItC/LQAOATLO)  for  air- 
frames delivered  after  Hovember  1961 . Prior  acceptance 
date  information  was  destroyed  by  fire  and  had  to  be 
estimated  from  delivery  schedule  information  provided  by 
the  manufacturer. 

Two  problems  with  using  the  delivery  schedule 
dates  arose.  First,  the  schedule  gave  dates  by  month 
and  year  only.  To  minimize  the  error  related  to  this 
problem,  the  actual  delivery  date  was  assumed  to  have  been 
on  the  15th  day  of  the  scheduled  month. 

The  second  problem  was  that  these  schedules 
reflected  the  delivery  months  called  for  by  contract , but 
were  not  necessarily  the  actual  delivery  months.  To  deter- 
mine the  extent  of  this  problem,  a comparison  of  actual 
acceptance  dates  with  delivery  schedule  dates  for  air- 
frames delivered  after  Hovember  1961  was  made.  Since 
this  coBQarison  revealed  very  few  discrepancies , the  | 

delivery  schedule  dates  were,  therefore,  asstmed  to  be  | 

acceptable  substitutes  for  the  actual  acceptance  dates  i 

J 

for  airframes  delivered  from  the  first  eight  lots  of 

T-38  data.  j 

i 

s 

i 

j>  i 
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ixiother  asaumption  that  relates  to  the  «itire 
data  set  was  that  data  for  the  program  were  a population 
ceosas  aad  ziot  a sasiple.  This  la  true  since,  even  though 
the  7-5  is  still  in  production,  only  historical  data  were 
analTzed.  Li  this  context,  the  statistics  derived  were 
direct  descriptions  of  the  population  within  the  limits 
of  the  model's  ea^lanatoxy  power  and  the  research  metho- 
dolog7.  JTo  generalisation  of  model  coefficients,  beyond 
the  program  for  which  the  model  is  tailored,  was  atten^ted, 

stnniAEi  07  MEm)iX)LOGr,  issokfeions,  md  lhhtahobs 

The  approach  analysed  historical  production  data 
using  multiple  linear  regression  analysis.  Statistical 
and  criteria  tests  were  established  to  evaluate  the 
efficiency  of  Smith's  model  as  an  e^lainer  of  variations 
in  direct  labor  hotu?  requirements  for  airframe  produc- 
tion. Additional  procedures  and  associated  criteria 
testa  were  outlined  to  test  the  predictive  ability  of  his 
model.  When  all  statistical  azid  criteria  tests  were  met, 
the  concltxsion  that  production  rate  was  an  important  con- 
tributor to  eaqplaining  direct  labor  hour  variations  was 
supported.  Tinally,  the  conclusion  that  Smith's  full 
model  is  an  appropriate  modification  to  the  standard 
learning  curve  model  was  supported. 
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strength,  and  validity  of  these  conclusions 
were  evaluated  in  terms  or  the  assumptions  and  limitations 
inherent  in  the  methodology.  Vith  tliat  in  mind,  a recap 
or  these  assumptions  and  limitations  is  provided. 


Historical  data  obtained  from  the  manufacturer 
were  accurate. 

She  data  were  accurately  measured  and  manipxilated; 
particularly  for  lot  midpoint  and  production  rate  calcu- 
lations. 

Logaritbmic  transformation  of  data  to  facilitate 
multiple  linear  regression  Introduced  no  significant  loss 
of  data  precision. 

Limitations 

Sub;) active  analysis  was  required  to  assess 
validity  of  error  term  assumptions. 

Limited  number  of  data  points  resulted  in 
reduction  of  statistical  "leverage"  (i.e.,  limited 
degrees  of  freedom  in  statistical  tests)  in  some  instances. 

The  extent  of  error  introduced  by  estimating 
the  actual  acceptance  dates  from  delivery  schedules  for 
the  first  eight  lots  of  T-3€  airframes  cannot  be  fully 
ascertained. 


Chapter  ^ 


pm  iismzsis  iiip  mpnrGs 

The  two  haaic  functions  of  this  chapter  are  to 
describe  the  T-38/^-5  data,  obtained  from  the  manufacturer, 
and  to  present  the  results  and  findings  obtained  from  their 
analTsis.  The  intent  is  to  present  this  information  with 
directness  and  as  little  bias  prejudice  as  possible. 
With  this  in  mind,  tabular  presentations  are  used  when- 
ever possible.  Por  the  same  reason,  discussions  are 
limited  to  the  minimum  necessary  to  describe  the  format 
of  the  various  tables  and  to  indicate  what  was  done  to 
arrive  at  the  tabulated  information.  The  verbeil  sum- 
maries provided  at  the  end  of  each  section  and  at  the 
end  of  the  chapter  are  designed  to  merely  recap  the 
important  findings  with  few  or  no  "recLl-world"  interpre- 
tations. Such  interpretations  eire  reserved  for  disctis- 
sion  in  Chapter  5* 

This  chapter  is  divided  into  six  sections.  The 
first  provides  a description  of  the  data,  the  next  three 
present  analyses  of  the  data  relative  to  each  research 
hypothesis,  the  fifth  presents  a finding  related  to  all 
three  research  hypotheses,  and  the  final  section  provides  . 
an  overall  summary  of  the  analyses. 
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1-38/1-5  BiXX  BESCBIPnail 

With,  tke  exception  o£  tlxe  adxcraft  acceptance 
datea  discuaaed  in.  Chapter  5*  the  data  were  obtained 
directly  from  the  manufactiirer.  Specifically,  the 
manufacturer  provided  labor  hotir,  DC?S  vrei^t,  inclusive 
tail  number  and  fabrication  release  date  information  by 
production  lot  for  each  of  the  following  airframe  models: 
1-38,  E-5A»  E-5AG,  EE-5A,  SE-5AG,  P-5B,  E-5BG,  and  P-5E. 
The  labor  hour  data  were  further  separated  into  three 
categories:  total,  fabrication,  and  assembly.  The 
above  data  were  provided  for  all  airframes  built  for 
each  model  except  the  P-5E.  Since  the  E-5E  was  still  in 
production,  only  five  lots  of  data  were  available  for 
this  model.  Table  5 summarizes  the  number  of  edrframes 
for  each  model  that  was  produced  in  each  lot. 


-1 

The  manuTactTurer  developed  a single  data  source 
document,  from  numerous  data  files  and  records  at  his 
disposal,  in  support  of  this  research.  This  single 
document  is  the  source  of  all  data  discussed  and  tabu- 
lated, with  the  exception  of  aircraft  acceptance  dates 
as  previously  discussed. 

The  manufactruTer  considers  much  of  the  data  to  be 
proprietary.  lor  that  reason  numerous  table  entry  values 
have  been  masked  in  the  published  version  of  tiiis  thesis. 
Access  to  these  masked  values  can  be  obtained  from  the 
authors  upon  written  approval  from  ITorthrop  Aircraft 
Corporation. 
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Table  3 

Lot  Cooposltioa 


5 


^5 

16 

19 

36 

36 

36 

36 

36 

36 

36 

7 

36 

• 

36 

7 

36 

> 

7 

36 

12 

8 

29 

16 

47 

29 

— 

47 

30 

7 

46 

32 

3 

9 

2 

4d 

24 

12 

9 

2 

48 

39 

— 

11 

— 

64 

23 

• 

— 

29 

33 

11 

12 

4 

51 

34 

- 

— 

46 

21 

11 

— 

• 

64 

13 

— 

— 

35 

31 

• 

13 

16 

4 

44 

34 

• 

3 

- 

69 

8 

• 

— 

— 

8 

5 

• 

16 

» 

• 

9 

— 

- 

- 

15 

2 

16 

• 

16 

19 

• 

. 

• 

21 

10 

2 
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Sable  3 (Coattaued) 


Lot  # 

S-38 

?-5A. 

J-5B 

EP-54  HP-54&  P-5A.G  P-5BG 

P-5E 

39 

20 

39 

40 

23 

a 

9 

41 

a 

17 

42a 

4-3 

2 

11 

44 

14 

5 

4-5 

20 

21 

46 

10 

12 

47 

62 

46 

62 

®Lot  42  was  used  for  production  o£  Items  tliat  were 
common  to  all  airframes  still  in  production.  The  labor 
botirs  consumed  iu  this  lot  were  assigued  to  airframes 
actually  produced  in  subsequent  lots. 
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Data  Accommodation. 

Qaa  characteristic  of  the  data  set  that  is  act 
aeconmodated  hj  the  leasxiiis  ctirre  aodela  is  the  exten- 
sive design  change  between  the  ?-5B  and  ?-5E.  !I!his 
change  is  reflected  in  the  data  set  b7  an  approximate 
15  percent  Increase  in  DC?R  wel^t  for  the  7-5S  and  b^ 
an  abrupt  475  percent  increase  in  total  labor  hotirs  per 
pound  for  the  first  lot  of  7-5S  airframes  > Preliminarj 
regression  analysis  with  thu  five  ;-5E  lots  included  in 
the  data  set  vividly  revealed  the  inability  of  the  model 
to  account  for  this  drastic  labor  hotir  variation.  Based 
on  this  preliminary  finding,  the  data  from  lots  44  through 
48  were  omitted  from  the  analysis  presented  for  hypoth- 
esis testing  in  the  next  tliree  sections  of  this  chapter. 
While  this  omission  of  data  may  seem  arbitrary,  the 
reader  is  reminded  that  the  primary  thrust  of  this  and 
Smith's  research  was  to  determine  if  his  model  could  be 
adapted  to  the  production  of  an  ongoing  program.  In  his 
words,  "frequent  engineering  changes  seem  to  be  dynamic- 
ally accommodated  as  long  as  the  changes  are  not  major 
Support  for  this  statement  is  shown  in  later 
sections,  where  the  relatively  minor  changes  between 
the  other  airframe  models  presented  no  partictilar 
problem. 
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i 
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Data  Combiaatioiia 

Aa  ijidicated  earlier  in  Table  5*  extenslTe  oveiv' 
lap  and.  siioaltaiieous  productlozi  of  difier^t  models 
occurred  during  tie  ma;Jorit7  of  tie  T-38/P-5  program. 
Because  of  these  multi>^odel  production  lots,  data  for 
various  combinations  of  airframe  models  vrere  evaluated 
against  the  three  research  bTpotheses.  After  preliminazy 
analysis  of  more  than  a dozen  combinations , five  were 
selected  as  showing  promise  for  father  analysis. 

The  data  combinations  are  referred  to  as  test 
situations,  and  actual  regression  analysis  input  data 
for  each  combination  is  tabulated  in  Appendix  A. 

Table  6 provides  a synopsis  of  the  data  contained  in 
each  test  situation,  and  the  following  discussion  is  keyed 
to  this  table. 

In  general,  each  test  situation  number  represents 
the  combination  of  airframe  models  used  to  generate  the 
variables  for  regression  analysis  and  predictive  ability 
testing.  For  each  combination,  each  labor  hour  category 
and  each  production  rate  prory  was  analyzed. 

The  second  table  column  indicates  the  range 


of  lots  from  which  the  data  were  extracted.  To  avoid 
confusion  in  later  discussions,  note  in  Table  3 that 
some  lots  were  skipped  in  the  production  sequence  of 


Regreaaion  Analyala  Teat  Sltuationa  Sumaarised 
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each  airframe  model.  The  mmber  of  cases  (data  plot 
poijits)  used  in  the  regression  analjsis  of  each  test 
situation  was,  therefore,  usually  less  than  the  inclusive 
nomber  of  lota  in-  the  range. 

The  Labor  E^^lra  Variable  column  reflects  the  air- 
frame model  or  models  for  which  labor  data  were  con^iled. 
For  example,  the  designation  of  "T-38/Basic  P-5"  refers 
to  all  T-38  airframes  produced  plus  the  basic  P-5  air- 
frames. Specifically,  the  T-3a,  P-5A,  and  P-5B  labor 
hotars  were  included,  but  the  labor  hours  for  the  P-5A.(x, 
EP-5A,  HP-5AG,  and  P-5BG  were  excluded.  This  omission 
of  the  special  models  in  Teat  Situation  2 closely  approxi- 
mates faith’s  similar  attec^t  to  develop  a homogeneous 
data  set  in  portions  of  his  research  (11:60-61), 

The  Cumulative  Output  column  of  the  table  indi- 
cates which  airframe  models  were  used  to  calculate  the 
cumulative  output  variable  for  regression.  Output  for 
all  airframe  models  was  xised  in  Test  Situations  1 and  2 
in  order  to  evaliiate  direct  labor  requirements  as  a 
function  of  the  production  of  all  airframe  models.  The 
great  similarity  between  models  implied  that  much  of  the 
learning  that  took  place  in  producing  one  model  was 
applicable  to  the  production  of  other  models.  In  Test 
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Situations  3y  and  3i  howerer,  an  attempt  was  made  to 
isolate  tlie  learning  achieved  on  the  T->38  models  from 
that  achieved  on  the  models  and  vice-versa.  In  these 
situations^  the  cumulative  output  variable  was  based  on 
the  cumulative  output  of  the  Indicated  models  onlj. 

As  a point  of  clarification,  Smith  did  not  examine  data 
combinations  equivalent  to  those  in  Test  Situations  3» 

4,  and  5. 

The  Production  Bate  column  indicates  the  portion 
of  airframes  in  each  lot,  b7  airframe  model,  tliat  was 
included  in  the  development  of  the  manufacturing  3:ate  and 
deliveiy  rate  variables.  The  designation  ''all  models" 
for  Teat  Situations  1 and  2 reflects  a plant-wide  rate 
of  production  for  all  models  produced  in  each  lot  under 
consideration.  As  was  the  case  for  cumulative  output, 
the  similarity  between  airframe  models  makes  this  plant- 
wide production  rate  seem  logically  appropriate  for 
evaluation.  Again,  however,  in  the  remaining  test 
situations  an  attesqpt  was  made  to  isolate  the  effects 
of  production  rate  of  certain  models  within  each  lot. 

For  instance.  Test  Situation  3 used  ozily  the  number  of 
T-38  airframes  produced  in  each  lot  to  determine  the 
production  rate.  Additionally,  the  manufacturing  rate 
and  delivery  rate  time  span  calculations  explained  in 
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Chapter  3 were  based  solely  oa  T-38  airframe  acceptance 

dates  and  fabrication  release  dates.  ] 

! 

EESEASCH  HIPOTHESIS  OSE  mLTSIS 

This  section  presents  the  regression  analysis 
results  for  Test  Situations  1 throu^  3 as  they  relate  to 
each  statistical  hypothesis  and  the  criterion  test  used 
to  support  this  research  hypothesis.  For  ease  of  refer- 
ence» the  Iiypotheses  and  criterion  test  are  reiterated 
in  summary  form  as  follows: 


5^ 


ShA  reaulta  obtained  Tor  each  test  situation  are 
indiridnallj  tabulated  in  the  remainder  of  this  section. 
Aa  an  aid  to  intea^retine  the  tabular  format  ^ note  that 
reduced  model  results  are  the  same  regardleas  of  the  pro 
duction  rate  Tariable  pro^  used  in  the  full  model. 


Teat  Situations  1TM/1TD  Analysis  ResTilts 


Sbr  these  tests  the  total  labor  hours  for  all 
lots  and  all  models  were  regressed  against  the  cumalatiye 
output  for  all  models  and  the  plant-wide  production  rate. 
The  regression  results  and  hypothesis  test  conclusions 
are  summarised  in  Table  7*  regression  input  data 

are  presented  in  Appendix  A,  Table  19* 

Table  7 

Teat  Situations  'ITK/'ITB:  Regression 
Results  and  Conclusions 


Items  of  Concern 


Bumber  of  Cases 
Estimated  Bq 

Estimated 

Estimated  B2 

R^  (actual) 

(log) 

P*  (B^,  Bg  / 0) 

Pc  (Bv  ^2  0) 

Stat.  Eyp.  One  (A) 
P*  (Bg  / 0) 

Pg  (Bg  / 0) 

Stat.  ^7p.  One  (B) 
Residual  Bistn. 
Criterion  Test 


Reduced 


1TM/1TD 


masked 

masked 

masked 

masked 

masked 

masked 

— 

masked 

masked 

1295.78 

627.55 

3.2A 

3-2H- 

Reject  B^ 

Reject 

135.39 

^.08 

46.79 

4.08 

Reject  ^ 
Acceptable 
Passed 

Reject  Bq 
Acceptable 
Passed 

Teat  Situations  2IW/2ID  Anaijalg  Reaulta 

Ibr  these  teats  total  labor  hours  for  the  T-33y 
7-5A.*  asd  7-5B  ozilj  were  regressed  against  the  ouBulative 
output  and  the  plant-wide  production  rate  for  all  models. 
Results  are  summarized  in  Table  8 and  input  data  are  in 
Appendix  A,  Table  20. 

Table  8 

Test  Situations  2TH/2TI}:  Regression 
Results  and  Conclusions 


Item  of  Concern 

Reduced 

Model 

Pull 

Model 

2TM/2ID 

2TM 

2TD 

Number  of  Cases 

4-1 

4-1 

4-1 

mashed 

mashed 

mashed 

=1 

mashed 

mashed 

mashed 

®2 

— 

mashed 

mashed 

R^  (actual) 

o.w 

0.987 

0.973 

(log) 

0.938 

0.986 

0.972 

(B>,,  Bg  / 0) 

— 

1311.65 

669.90 

»0  <Bi.  h * 

— 

3.25 

3.25 

Stat.  I(7p.  One  (A) 

— 

Reject 

Reject  Hq 

1 (Bg  4 0) 

-- 

125.70 

^.75 

Pq  (Bg  4 0) 

— 

4..10 

4..10 

Stat.  One  (B) 

Reject  Eb 

Reject  Ho 

Residual  Bistn. 

— 

Acceptable 

Acceptable 

Criterion  Test 

— — 

Passed 

Passed 
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Test  Situations  ySa/ysa  Analysis  Results 


la  tliese  tests  total  labor  hours  for  the  S-3b 
onlj  were  regressed  against  the  T-3S  cumulatire  output 
and  the  portion  of  the  plant-wide  production  rate  in 
each  lot  that  could  be  attributed  to  T-38  production. 
Results  are  sumaarizad  in  Table  9 and  the  input  data  are 
presented  in  Appendix  A,  Table  21. 

Table  9 

Test  Situations  ynn/yn):  Regression 
Results  and  Conclusions 


Items  of  Concern 


Rumber  of  Cases 

5o 


(actual) 

Clog) 

P*  (B^,  Bg  / 0) 

Pc  (B^,  Bg  / 0) 
Stat.  ^7p.  One  (A) 
P*  (Bg  / 0) 

Pe  (Bg  0) 

Stat.  ^Tp.  One  (B) 
Residual  Bistn. 
Criterion  Test 


Reduced 


ym/ysB 


masked 

masked 

masked 

masked 

masked 

— 

masked 

masked 

0.979 

0.988 

0.990 

0.972 

0.991 

0.987 

— 

177^.^7 

1287.41 

— 

3.28 

3.28 

— 

Reject 

Reject  Hq 

— 

64.91 

38.01 

— 

4.13 

4.13 

— 

Reject  ^ 

Reject  Ho 

— 

Acceptable 

Acceptable 

Passed 

Passed 

Test  Sisnilations  A-1MATD  Analysis  Results 


?br  these  tests  total  labor  hours  for  all 
models  were  regressed  against  the  cumilatiye  output  for 
all  7-5  models  and  the  portion  of  the  plant-wide  produc< 
tion  rate  attributable  to  all  7-5  models.  Results  are 
summarized  in  Table  10  and  the  input  data  are  presented 
in  Appendix  A,  Table  22. 

Table  10 

Test  Situations  4TK/4TI}:  Regression 
Results  and  Conclusions 


Items  of  Concern 


somber  of  Cases 

h 

R^  (actual) 

(log) 

7*  (B^,  Bg  ft  0) 

7^  (B^, 

Stat.  Btp»  One  (A) 
7*  (Bg  ft  0) 

7^  (Bg  / 0) 

3tat.  ^7p.  One  (B) 
Residual  Bistn. 
Criterion  Test 


Reduced 

TuU  I 

Model 

Model  I 

4dai/4TB 

AOM 

ATB 

27 

27 

27 

masked 

masked 

masked 

masked 

masked 

masked 

— 

masked 

masked 

0.891 

0.933 

0.947 

0.896 

0.942 

0.934 

— 

193.61 

171. 08 

— 

3.40 

3.40 

— 

Reject  Hq 

Reject 

— 

18.81 

14.12 

— 

4.26 

4.26 

— 

Reject  Eq 

Reject  Bb 

— 

Acceptable 

Acceptable 

— 

Passed 

Passed 

Teat  Situations  3TI1/5TD  Analysis  Results 


These  were  the  last  tests  usin^  total  labor  hours 
as  the  dependent  variable » Speci£icall7,  total  labor 
hours  for  basic  models  onl7  were  regressed  against 
basic  7<-5  cumulative  output  and  the  portion  of  the  plant- 
wide  production  rate  attributable  to  these  basic  models. 
Results  are  summarized  in  Table  11  and  input  data  are 
presented  in  Appendix  A,  Table  23. 

Table  11 

Test  Situations  3^111/3^:  Regression 
Results  aM  Conclusions 


Items  of  Concem 


ITumber  of  Cases 

(actual) 

(log) 

1*  (B.,,  Bg  4 0) 
P.  (B.,  Bo  / 0) 


(B^,  Bg  / 0) 
Stat.  Byp.  One  (A) 
P*  (Bg  0) 

<^2  / 0) 

Stat.  S^.  One  (B) 
Residual  Distn. 
Criterion  Test 


Reduced 


3aM/5TD 


177.14 

234.13 

3.42 

3.42 

Reject  Hq 

Reject  Hg 

13.77 

28.77 

4.28 

4.28 

Reject  Eb 
Acceptable 
Passed 

Reject  ^ 
Acceptable 
Passed 

For  this  research  hypothesis  the  two  statistical 
hypotheses  azid  the  criterion  teat  concemins  total  labor 
hour  variations  were  evaluated.  Vithin  the  frsmewoxh  of 
the  five  basic  teat  situations , the  iopact  of  production 
rate  was  analysed  using  both  the  manuf  acturing  rate  and 
the  delivery  rate  proodes. 

In  every  situation  tested  the  full  model  showed 
very  strong  overall  significance  under  Statistical 

hypothesis  One  (A).  This  was  evidenced  by  the  over- 

« 

whelming  size  of  F statistics  when  compared  to  F^ 

o 

statistics  and  was  similarly  shown  by  the  very  high  H 
(actual)  values.  In  the  worst  situation  CITK)  the  full 
model  explained  93*3  percent  of  the  variatiozis  in  the 
labor  hours  variable,  and  in  the  best  situation  C3TD) 
it  explained  99*0  percent  of  the  variation.  Here 
ia^ortantly,  the  full  model  explained  approximately  four 
percent  more  of  the  variation  than  did  the  reduced  model 
in  all  situations  except  5TE1  and  3^  where  the  increase 
%ras  only  about  one  percent.  Ihe  significance  of  these 
increases  is  emphasized  in  the  following  discussion  of 
findings  for  the  production  rate  variable. 

The  produotion  rate  variable  was  shown  to  have 
a statistically  significant  relationship  with  variations 

e 


la  th.e  total  labor  hour  variable.  !I!!be  strengtb  ol  this 

m 

relationship  was  evidenced  b7  the  fact  that  F statis- 
tics under  Statistical  ^Tpothesis  One  (B)  were  consider- 
abl7  larger  than  tlie  F^  statistics  in  each  situation 

tested*  !E!he  smallest  margin  of  difference  between  F* 

« 

and  F_  occurred  in  Test  Situation  5^IM  where  F was  15.77 

G 

and  F.  was  4.28  at  the  0.05  level  of  significance.  How- 

ever,  even  this  F statistic  is  large  enough  to  permit 

rejection  of  at  the  0.005  level  of  significance  where 

Fq  would  increase  to  only  9.63- 

While  the  production  rate  variable  was  found  to 

be  significant  using  both  the  xaanxifacturlag  rate  and  ^ 

the  delivery  rate,  neither  of  these  proxies  demonstrated 

a clear  advantage  over  the  other.  For  instance,  the  full 

2 

model  with  manufacturing  rate  gave  higher  E values  in 
two  test  situations,  the  same  value  in  the  tliird, 
and  lower  values  in  the  last  two. 

Also  of  interest  was  the  fact  that  all  coef- 
ficients were  negative,  which  implied  an  Inverse  relation- 
ship between  the  variables..  Specifically,  as  the  produc- 
tion rate  variable  Increased,  the  labor  hours  variable 
decreased. 

Finally,  the  conditions  specified  in  the  criterion 
test  were  met  for  all  test  situations.  Specifically, 
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3 


for  each,  sitoatiozi  the  5^  Talue  for  the  full  model  was 
sroater  than  the  value  for  the  reduced  model,  and  the 
aaauo^tioiLS  concerning  reaiduala  were  not  violated. 

SESEASCE  Hno^rmais  two  aealtsis 


This  bTpotheals  is  the  same  as  Research  B^othesis 
One  except  that  labor  hours  are  examined  at  the  lower 
production  process  levels  of  fabrication  and  assemblj. 
Etxrther,  since  the  total  labor  hours-  examined  previously 
were  slsiply  the  stim  of  the  fabrication  and  assembly 
hours  examined  in  this  section,  findings  for  total  labor 
hours  represented  the  combined  effect  of  the  production 
rate  variable  on  fabrication  and  assembly.  * For  Instance, 
If  the  production  rate  variable  was  significant  for 
assembly  hours  but  not  for  fabrication  hours,  the  variable 

may  still  have  shown  significance  for  total  combined 

2 • 

hoxirs.  For  this  reason,  the  B and  F statistics  for 
the  total  hours  presented  in  the  prevlotis  section  should 
be  kept  in  mind  when  examining  the  findings  of  this 
section. 


For  these  tests  the  fabrication  labor  hotirs  and 
the  assembly  labor  hours  were  regressed  against  the 


I 


{ 
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cunulativa  output  for  adl  models  and  tlie  plant-wide  pro- 
duction rate*.  Results  are  susoiarized  in  Table  12  and 
input  data  are  presented  in  Appendix  A,  Table  19. 


3 


OJable  12 


Test  Situations  1IM/1FD  and  1AM/1AD:  Regression 
Resxilts  and  Conclusions 


Items  of  Concern 

Reduced 

Kbdel 

Pdll 

Modal 

1JM/1PD 

1IM 

1PD 

lihimber  of  Cases 

42 

42 

42 

Estimated 

masked 

masked 

masked 

Estimated 

masked 

masked 

masked 

Estimated  B2 

— 

masked 

ngialced 

H?  (actual) 

0.863 

0.974 

0.921 

(log) 

0.857 

0.970 

0.923 

ff*  (B^,  Bg  ^ 0) 

— 

624.68 

254.12 

Pq  (B^ , Bg  / 0) 

— 

3.24 

3.24 

Stat.  57p.  Two  (A) 

— 

Reject 

Reject  Eg 

P (Bg  0) 

— 

144.81 

39.08 

So  (Bg  0) 

— 

4.08 

4.08 

Stat,  55rp,  Two  (B) 

— 

Reject  Eo 

Reject  Eb 

Residual  Bistn. 

— 

Acceptable 

Acceptable 

Criterion  Test 

— 

Passed 

Passed 

1AM/1AD 

1AM 

1AB 

Btimber  of  Cases 

42 

42 

42 

Estimated  Bq 

masked 

masked 

masked 

Estimated  B^ 

masked 

masked 

masked 

Estimated  B2 

masked 

masked 

R^  (actual) 

0.971 

0.980 

0.986 

(log) 

0.965 

0.980 

0.977 

P (B,,,  Bg  fi  0) 

— 

976.11 

843.29 

(a, . Bj  0) 

— 

3.24 

3.24 

Stat,  ^7p.  Two  (A) 

— 

Reject 

Reject  Hq 

P (B2  ft  0) 

— - 

- 30.89 

21.56 

Bo  C®2  0) 

— 

4.08 

4.08 

Stat,  ^p.  Two  (B) 

Reject  Eo 

Reject  Ho 

Residual  Distn, 

Acceptable 

Acceptable 

Criterion  Test 

~ 

Passed 

Passed 
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Teel:  Situations  2SK/2FD  and  2A11/2AD 

for  these  tests  the  fahrication  and  assembly 
labor  hours  for  th.e  T-38t  and  f-3B  only  were 

regressed  sigainst  the  cumulatlTe  output  and  plant-wide 
production  irate  for  all  models » Results  are  summarized 
in  liable  13  and  input  data  are  presented  in  Appendix  A, 
Table  20. 


i 
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I*ble  13 

Test  Sitrxatioxis  2SK./2EIi  and  2A11/2AJ3;  Regression 
Results  and  Conclusions 


Items  of  Concern 

Reduced 

Kodel 

Pull 

Hbdel 

2iII/2PD 

2m 

2PD 

liTumber  of.  Cases 

41 

Estimated  Bq 

masked 

masked 

masked 

Estimated 

masked 

masked 

masked 

Estimated  B2 

~ 

masked 

masked 

R^  (actual) 

0.877 

0.968 

0.925 

2^  (loff) 

0.863 

0.976 

0.934 

P*  (B^ , Bg  0) 

— 

576.84. 

268.78 

fB., , Bg  ^ 0) 

— 

3.25 

3.25 

Stat*  57P*  Two  (A) 

41 

— 

Reject 

Reject 

F (Bg  / 0) 

— 

12A.78 

40.62 

(Bg  0) 

— 

4.10 

4i10 

Stat.  Rtp.  Two  (B) 

...  ' 

Reject  ^ 

Reject  Bb 

Residual  Distn» 

— 

Acceptable 

Acceptable 

Criterion  Test 

— - 

Passed 

Passed 

2AM/2AI) 

2m 

2AD 

Ifumber  of  Cases 

41 

41 

Estimated  Bq 

masked 

masked 

masked 

Estimated  B^ 

masked 

masked 

masked 

Estimated  B2 

■— 

masked 

masked 

R^  (actual) 

0.973 

0.979 

0.986 

(log) 

0.967 

0.981 

0.978 

P*  (B. , B2  / 0) 

— 

960,61 

826.07 

n 

0 

— 

3.25 

3.25 

Stat.  ^Tp.  Two  (A) 

0 

— 

Reject 

Reject 

P (B2  / 0) 

— 

25.75 

17.00 

Fc  (B2  / 0) 

— 

4.10 

4.10 

Stat.  Rtp.  Two  (B) 

.. 

Reject  Eo 

Reject  Bo 

Residual  Distn. 

Acceptable 

Acceptable 

Criterion  Test 

Passed 

Passed 

i 
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Teat  Situations  and  ^AM/^iAD 

lor  tiiese  tests  fatxicatioa  and  assembl7  labor 
bouzs  for  the  T-3a  only  were  regressed  against  the  T-38 
cumolatire  output  and  the  portion  of  the  plant-wide 
production  rate  in  each  lot  that  was  attributable  to 
T-38  production.  Results  are  summarized  in  Table  14 
and  injut  data  a3;e  presented  in  Appendix  A,  Table  21.. 
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Table  14 

Test  Situations  3IM/3PD  and  JAM/JAD: 

Besults  and  Conclusions 


Regression 


Items  of  ConcezxL 


somber  of  Cases 
Estimated  Bq 

Estimated 

Estimated  B2 

R^  (actual) 

(log) 

?*  (a, , )<  0) 

Stat.  57p.  Two  (A) 

E*  CBg  0) 

Ec  (Bg  0) 

Stat,  ^snp.  Two  (B) 
Residual  Bistn. 
Criterion  Test 


IFumber  of  Cases 
Estimated  Bq 

Estimated  B^ 

Estimated  B2 

R?  (actual) 

(log) 

?*  (B^ , 0) 

»o  <®1>  ®2 
Stat.  l(7p.  Two  (A) 

E*  (Bg  ^ 0) 

Stat.  ^7p.  Two  (B) 
Residual  Bistn. 
Criterion  Test 


Reduced 

Kbdel 


i\ill 

Hodel 


Ie«t  Situations  4H1/4PD  and  4.AM/4.AD 

Tor  these  testa  fahrlcatioa  sad  aasenibl7  labor 
hours  for  all  7-5  models  were  regressed  against  the 
cumulative  output  of  all  7-5  models  and  the  portion  or 
the  plant-wide  production  rate  attributable  to  these 
models.  Results  are  summarized  in  Table  15  and  input 
data  are  presented  in  Appendiac  A,  Table  22. 


Table  15 

Test  Situations  4IX1AJD  and  4111 AAS: 

Heaults  and  Conclusioxia 


Hegreasion 


f 

Items  or  Concern 

Redxiced 

Kodel 

Pull 

Model 

4BMAPD 

4HI 

4PD 

Sbmber  of  Cases 

27 

27 

27 

Estimated  Bq 

masked 

masked 

masked 

Estimated  B>| 

masked 

masked 

masked 

Estimated  B2 

masked 

masked 

5^  (actual) 

0.772 

0.864 

0.877 

E^  (log) 

0.740 

0.855 

0.847 

P*  (B^,  Bg  0) 

— 

71.01 

66.46 

ir 

'e  Ba  i'  0^ 

— 

3.40 

3.40 

Stat.  Two  (i.) 

— 

Reject 

Reject  Eg 

P*  (Bg  0) 

— 

19.20 

16.83 

Pq  (B2  0) 

— 

4.26 

4.26 

Stat.  Etp.  Two  (B) 

Reject  Bb 

Reject  % 

Residual  Bistn. 

— 

Acceptable 

Acceptable 

1 

a 

Criterion  Test 

~ 

Passed 

Passed 

1 

j 

i 

411I/4AI} 

4AM 

4AD 

1 

> 

BUmber  of  Cases 

27 

27 

27 

{ 

Estimated  Bq 

masked 

masked 

masked 

Estimated  B^ 

masked 

masked 

masked 

Estimated  B2 

— 

masked 

masked 

(actual) 

0.930 

0.951 

0.958 

■ (log) 

0.940 

0.955 

0.950 

P*  (B^,  Bg  / Q) 

— 

256.49 

229.69 

Bj  ^ 0) 

— 

3.40 

3.40 

Stat.  Two  (1) 

-- 

Reject 

Reject  Eq 

E*  (Bg  0) 

— 

82.89 

5.06 

P^  (Bg  / 0) 

-- 

4.26 

4.26 

Stat.  Snp.  Two  (B) 

— 

Reject  Eq 

Reject  Eo 

Residual  Distn. 

— 

Acceptable 

Acceptable 

Criterion  Test 

~ 

Passed 

Passed 
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lest  Situations  5H1/5ED  and  5AM/5AJ) 


;| 


In.  this  last  set  of  tests  the  fabricatioa 
assemhlj  labor  hoiixs  for  basic  7<->5  models  only  were 
regressed  against  the  basic  P~5  cumuXativ’e  oatpnt 
the  portion  of  the  plant-wide  production  rate  attribut- 
able to  these  basic  models.  Hesults  are  summarized  in 
Xable  16  and  input  data  are  presented  in  Appendix  A, 


Table  23* 


Bbte  that  under  Test  Situation  5^  the  null 
hypothesis  could  not  be  rejected  at  the  0.03  level  of 
significance  under  Statistical  hypothesis  Two  (B).  This 
condition  is  flagged  with  an  asterisk  in  Table  16  and  is 
discussed  more  fully  in  the  summary  portion  of  this 
section. 


j 
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Sable  16 


Seat  Situatloos  5^2Ji/3FD  azid  3-A11/5AS:  Hegresaloix 
Beaolta  and  Coaielusiozia 


IteBia  of  Conceal 


Btnnber  of  eases 
Estimated  Bq 

Estimated 

Estimated 

(actual) 

(log) 

E*  (B^,  Bg  / 0) 

Be  <Bl*  Bg  0) 
Stat.  BtTp.  Two  (i.) 
E*  (Bg  0) 

Ec  (Bg  0) 

Stat.  B!7p«  Two  (B) 
Besidual  Distn. 
Critexion  Test 


BUmber  of  oases 
Estimated 

Estimated  B^ 

Estimated  Bg 

B^  (actual) 

(log) 

»’  (R, , Bg  )<  0) 
(B^,  Bj  0) 
Stat.  Qtp.  Two  (A) 
E*  (Bg  ft  0) 


(Bg  / 0) 


Stat.  a^.  Two  (B) 


Oxlteriozi  Test 


Bsduced 

Model 

Eull 

Model 

53M/5ED 

5m 

3ED 

26 

26 

26 

masked 

masked 

masked 

masked 

masked 

masked 

— 

masked 

masked 

0.771 

0.822 

0.873 

0.711 

0.750 

0.803 

— 

3^.5^ 

A7.44 

— 

3.^2 

3.A2 

— 

Reject  H 

Reject  Hg 

— 

3.57 

11.01 

— 

4.,  28 

A.28 

m 

Reject  % 

Acceptable 

Acceptable 

Passed 

Passed 

5AM/5AB 

3AM 

3AD 

26 

26 

26 

masked 

masked 

masked 

masked 

masked 

masked 

— 

masked 

mausked 

O.W 

0.971 

0.982 

O.W 

0.976 

0.976 

— 

A75.81 

A68.35 

— 

3.^2 

3.A2  ; 

— 

Reject  Hq 

Reject  Hq 

— 

26.32 

23.78 

— 

A.  28 

A.28 

— 

Reject  So 

Reject  So 

~ 

Acceptable 

Acceptable 

Passed 

Passed* 
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Reaearch.  Hrpotlieaia  Tvro  g»nmaTy 

Tor  thia  raaearch.  h^potlioala  the  two  atatistical 
t^otheaea  axid  the  orlteriozi.  teat  were  evaluated  using 
fabslcatioiL  labor  hours  and  aaaenblj  labor  hours , 
respectivel7}  aa  the  dependent  variable » Both  produc- 
tion rate  variable  proxies  were  again  evaluated  with 
each  combination  of  data. 

Aa  was  found  for  total  labor  hours  under  Research 
£(7po thesis  Qae,  the  full  model  allowed  overwhelming 
significance  in  Statistical  i^fpothesis  Two  (A)  for  all 
teat  situations.  However,  the  production  rate  variable 
in  Test  Situation  5M  was  not  significant  at  the  0.05 
level  of  significance  under  Statistical  Boothes  is  Two 
(B).  In  order  to  place  thia  bTpothesis  test  failure  in 
better  perspective  the  production  rate  variable  in  this 
test  situation  was  significant  at  the  0.10  level  of 
significance  where  P.  decreased  to  2.9^. 

w 

Although  the.  production  rate  variable  was  not 
8tatiaticall7  significant  at  the  prespecified  0.05  level 
for  the  one  teat  situation,  the  sign  of  the  Bg  coef- 
ficient was  always  negative.  This  implied  that  the 
inverse  relationship  between  production  rate  variable  and 
total  labor  hours  variable  held  for  the  lower  process 
levels  of  production  also. 

7^ 


m 


m 


As  to  which  production  rate  pros7  gave  the  heat 

results,  the  advantage  of  one  over  the  other  was  again 

\mclear.  Ihe  full  model  with  manufacturing  rate  did 

give  better  values  in  the  first  three  aitxiations  for 

fabrication  hours,  but  the  fall  model  with  delivery  rate 

excelled  in  the  last  two.  ?or  assembly  hours  the  delivery 

rate  gave  higher  B values  for  every  test  situation,  but 

2 

the  increase  over  B values  for  the  manufacturing  rate 
was  only  about  one  percent  in  each  situation.  So,  as  in 
findings  under  Besearch  Bypo thesis  One,  neither  proxy 
held  a distinct  advantage. 

Finally,  the  criterion  test  was  passed  for  all 

test  situations  with  the  exception  of  a mixed  result  in 

2 

Test  Situation  3AII.  In  this  situation  the  B (log)  for 

2 

the  fall  model  was  higher  than  R (log)  for  the  reduced 

2 

model,  bat  the  relationship  was  reversed  for  the  B 

(actual)  statistics.  In  both  instances,  however,  the 
2 

difference  in  B values  was  less  than  one  percent 

« 

vhloh  would  seem  insignificant.  However,  the  F and  F^ 
statistics  under  Statistical  BTpo thesis  Two  (B)  indicated 
that  the  production  rate  variable's  contribution  to  the 
eag^lained  variation  (E7)  was  significant.  Based  on  this 
additional  information,  the  criterion  test  was  deemed 
to  have  been  passed. 
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EESSEAfiCH  HTPOTBESIS  AWAT.TgTfi 

Since  a statistical  hTpotliesis  could  not  be 
derreloped  to  support  testing  this  third  research  h7poth> 
esiSy  the  following  sub;]ectiTe  criterion  test  was  used. 

SpeciTicallj,  the  full  model's  predictive  abilitT-  was 
accepted  as  good  if  the  one  year  predictions  did  not 
deviate  from  observed  values  by  more  than  five  percent. 

The  predictive  ability  of  the  model  was  tested  against 
this  criterion  test  for  all  test  3it^lations. 

Since  only  historical  data  were  available,  pre- 
dictions beyond  the  range  of  the  data  set  obviously  could 
not  be  evaluated.  Btowever,  predictions  into  the  future  . J 

were  simulated  by  regressing  each  model  against  the  data 
set  in  each  test  situation  with  the  last  few  cases 
omitted  during  regression.  The  regression  coefficients 
obtained  from  these  reduced  data  sets  were  then  used  to 
obtain  predictions  for  the  values  in  the  omitted  cases. 

Predictions  by  both  the  full  and  reduced  models  were 
thus  obtained  and  the  results  were  cooqpared  to  the 
observed  values  in  the  omitted  cases. 

One  complication  arose  in  selecting  the  "target 
lot"  for  which  predictions  were  to  be  made.  Por  example, 
the  multi-model  combinations  in  the  various  lots  presented 
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a dllemna  tn  choosiog  a represeatatlTe  lot.  Lot  40  was 
chosan.  on  the  basis  that  it  contained  a nucture  of  T-38/ 
7-3  ead  special  Teraions  of  the  airframe  (Hef.  (Cable  3). 

As  in  previous  sections,  the  anal7sis  is  sum- 
marized in  Sable  17  and  Appendix  B.  A brief  - description  of 
table  format  and  content  is  offered  to  assist  interpre- 
tation. 

Each  table  is  divided  into  three  horizontal  sec- 
tions. She  center  and  bottom  sections  list  information 
for  the  full  model  using  the  manufacturing  rate  and 
delivery  rate,  respectively.  She  top  section  lists 
information  for  the  reduced  model  that  corresponds  to 
both  full  models. 

She  first  column  indicates  the  last  case  that 
was  contained  in  the  reduced  data  set  for  which  regres- 
sion coefficients  were  obtained.  As  a means  of  identi- 
j!ying  trends  in  the  predictive  ability  of  the  model  as 
the  predictive  time  span  increased,  the  number  of  cases 
omitted  was  progressively  increased  from  one  to  twelve. 
Sowever,  to  reduce  the  volxuie  of  information  in  each 
table,  data  are  recorded  for  every  other  data  set  rather 
than  for  all  12. 

She  asterisked  number  in  this  first  column 
indicates  the  prediction  time  span  that  is  closest  to 
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one  year.  This  time  span  was  based  on  the  date  when 
the  last  airframe  was  accepted  for  the  laust  lot  (case), 
included  in  detexmlniog'  the  regression  coefficients,  to 
the  date  of  fabrication  release  of  lot  40.  This  was 
deemed  appropriate  since  all  data,  including  these 
dates,  were  necessary  inputs  to  the  regression  analysis. 

So,  while  on  the  average  three  or  fotir  lots  were  started 
eaclL  year,  six  cases  were  omitted  in  order  to  arrive  at 
an  approsnate  one  year  predictive  time  span  for  the 
situations  tested. 

The  Bq  , B>| , and  Bg  columns  in  each  table  indicate 
the  coefficients  obtained  from  regressing  the  correspond-  ^ 

ing  number  of  cases.  The  next  column  indicates  the  pre- 
dicted labor  hours  variable  value  for  lot  40.  The  final 
column  indicates  the  percentage  deviation  of  the  predicted 
value  from  the  observed  value. 

Predictive  Ability  Tests  for  All  Test  Situations 

Predictive  ability  test  results  for  Test  Situa- 
tions ITK/'^TB  are  summarized  in  Table  1?.  Besults  for 
all  other  test  situations  are  recorded  in  Tables  24- 
throu^  38  in  Appendix  B.  Discussion  concerning  all 
test  situation  results  is  contained  in  the  summary  of 
this  section  of  the  chapter. 
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Table  17 

Pradlctiva  Ability  Teat  Situation  ITM/ITO 


Seduced 

Model  - ITM/lTD 

Cases 

82  Forecast* 

% 

Deviation 

38 

aasiced 

masked 

— 1.94 

-6.7 

36 

— 1.83 

-12.0 

34* 

— 1.77 

-14.9 

32 

— 1.73 

-16.8 

39 

— 1.67 

-19.7 

28 

— 1.63 

-21.6 

Pull 

Model  • ITM 

Cases 

»0 

®1 

82  Forecast* 

% 

Deviation 

38 

aasiced 

masked 

masked  2.16 

3.8 

36 

2.19 

5.3 

34* 

2.19 

5.3 

32 

2.24  ' 

7.7 

30 

2.22 

6.7 

28 

2.22 

6.7 

Full 

Model  ITO 

Cases 

®0 

82  Forecast* 

% 

Deviation 

38 

masked 

masked 

masked  2.14 

2.9 

36 

2.12 

1.9 

34* 

2.06 

-1.0 

32 

2.02 

-2.9 

30 

2.01 

-3.4 

28 

» 1.99 

-4.3 

*Foracaats  are  aad«  for  the  labor  hours  variable 
in  Lot  #40  (Case  40}  for  which  the  observed  value  is 
2.00  hours  per  pound. 

* - Indicates  approximate  one  year  time  span. 
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HeggarciLj5j2othgsis_®bxee_Ana^2iSL§HffiSt 

Si2ic9  tha  one  year  predlctlre  time  spaa  results 
axe  of  pxtmax7  tatexest,  tlie^r  axe  susnnaxized  ia  Table 
18  for  tbe  15  teat  sltuatloae  aaaljzed  with  each  model. 
Specifically'),  the  aumbex  of  test  situations  ia  which  the 
deviation  ia  each  models'  prediction  was  leas  than  five 
percent  and  tea  percent  are  indicated.  Althou^  the 
cxitexioa  teat  specified  an  arbitrarily  chosen  fire  per> 
cent  as  the  acceptable  deviation  limit)  the  information 
for  tea  perc«it  is  also  provided  to  give  a better  per- 
spective of  overall  performance. 

As  indicated  in  Table  18)  the  full  model  gave 
better  predictions  far  more  often  tlian  the  reduced  model. 
PirtheX)  the  full  model  with  the  delivery  rate  variable 
performed  sli^tly  better  than  the  full  model  with  the 
manufacturing  rate  variable. 

When  predictive  performance  by  labor  hour  cate- 
gory was  examined,  the  findings  were  mixed.  For  instance, 
the  five  percent  deviation  limit  for  total  labor  hours 
was  exceeded  three  times  with  the  manufacturing  rate 
model  and  only  once  with  the  delivery  rate  model.  The 
findings  were  similar  for  assembly  hoTxrs  but  the  advan- 
tage switched  to  the  manufacturing  rate  model  when 


j 1 


-80 


fabxicatioa  hours  wore  examined*  !Ehe  question  o£  which 
labor  hour  category  yielded  the  best  predictive  perf  or- 


masee  reoalned  debatable. 

Vihen  other  than  the  one  year  predictive  time 
spans  were  examined,  a veiy  strong  trend  was  detected. 
In  most  test  situations  the  predictions  tended  to  get 
worse  as  the  predictive  time  span  increased.  Specific- 
ally,  the  predicted  values  became  progressively  smaller. 
This  trttid  was  particularly  pronounced  for  the  reduced 
model  predictions,  which  in^lied  that  the  slope  of  the 
curve  for  the  reduced  model  became  progressively  more 
shallow  as  production  output  increased. 

In  contrast  to  the  downward  trend  in  the  reduced 
model's  predictions,  half  of  the  full  model  results 
revealed  either  no  detectable  trend  or  a sli^t  upward 
trend.  Further,  since  almost  8dl  reduced  model  predic- 
tions fell  below  the  observed  values,  the  full  model 
also  had  the  overall  effect  of  raising  the  predicted 
value. 

In  general  then,  the  use  of  the  full  model, 
rather  than  the  reduced  model,  for  making  predictions 
revealed  two  distinct  advantages:  (1)  the  predictive 
ability  was  substantially  improved  in  the  vast  majority 

82 


) 


of  Altuations  tested,  and  (2)  the  predictlona  shotied 
greater  stabilltT’  orer  a hxoader  range  of  predictlre 
time  spans. 

griMM&TiT  QP  nVBRAT.T.  ATTA  TTSTg  XSD  TTnTDTffRfi 

chapter  diseosaed  and  presented  the  manipu- 
lation and  combining  of  data,  analjsed  the  ability  of 
the  production  rate  variable  to  ea^lain  additional 
variations  in  the  three  labor  hours  categories,  and 
finally,  co^ared  the  predictive  abilities  of  the  reduced 
and  full  models.  She  following  discussion  integrates 
the  various  isolated  conclusions  and  findings  discussed 
in  ea^  previous  section  of  the  chapter. 

First,  the  collection  of  data  had  one  wealmess 
that  undoubtedly  affected  the  analysis  and  findings  to 
some  extent.  Ibis  weakness  was  the  inability  to  obtain 
exact  acceptance  dates  for  the  first  ei^t  lots  of  7-38 
airframes.  Since  these  dates  were  estimated  from 
delivery  schedules,  some  error  in  the  production  rate 
variable  calculations  existed  for  these  early  lota. 
Bowever,  since  actual  dates  from  subsequent  lots  com- 
pared very  favorably  with  delivery  schedule  dates,  the 
error  was  probably  not  large. 
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.Aaotbor  problem,  encoimtexed  was  tbe  inabilitj  of 
tbe  reduoedL  aod  full  models  to  accoomodate  tlie  suddea 
large  increase  in  labor  hour  requirements  for  pro- 
duction* Although  the  QCEE  weight  also  increased  with 
the  7-5E  airframe ) the  weight  increase  was  not  substan- 
tial owrtwgH  to  smooth  the  labor  hours  per  pound  of  air- 
frame variable • On  the  other  hand,  less  drastic  design 
changes  between  other  airframe  models  were  accommodated 
-7er7  well  b7  the  full  and  reduced  models. 

The  findings  for  Besearch  hypotheses  One  and  Two 
were  consistent  with  what  was  anticipated.  The  full 
model  for  all  labor  hour  categories  was  overwhelmingly 
significant,  and  (actual)  values  were  higher  with  the 
full  model  than  with  the  reduced  model  in  29  of  the  30 

situations  tested.  In  the  one  remaining  situation  (3^11) 

2 

the  reduced  model's  R value  was  less  than  one  percent 
greater  than  that  of  the  full  model. 

Also  tinder  the  first  two  research  hypotheses, 
the  production  rate  variable  was  found  to  be  significant 
in  29  of  the  30  situations  tested.  The  one  situation 
(33H)  where  the  production  rate  variable  was  not  found 
to  be  significant  at  the  prespec:  .led  0.03  level  of 
significance,  was  significant  at  the  0.10  level. 


inotber  anticipated  finding  concaming  tlia  pro- 
dnctloa  rate  variable  waa  that  tbe  B2  coefficient  waa 

ir 

nagatlTe  in  arexT*  aituation.  She  isqplication  of  thia 
finding  waa  that  aa  tlie  production  rate  variable  increaaed 
the  labor  houra  per  pound  variable  tended  to  decreaae. 

Xhe  findinga  under  Beaearcb.  ^^othaaia  Xhree 
were  more  ambiguoua  due  to  tbe  aubj  active  method  of 
evaluation.  Bowever,  the  predictive  abilit7  of  the  full 
model  waa  definitelj  better  than  that  of  the  reduced 
model  in  '^e  majority  of  situationa.  When  the  one  year 
predictive  time  spana  weare  examined,  the  full  model  with 
delivery  rate  outperformed  the  reduced  model  in  1 3 of  the 
13  aituationa  teated.  The  full  model  with  manufacturiog 
rate  performed  better  than  the  reduced  model  in  14  of  the 
13  aituationa. 

Inother  aignificant  finding  imder  Eeaearch  S^oth- 
eaia  Three  waa  that  the  reduced  model  results  indicated 
a progressive  reduction  in  the  learning  ctirve  slope  aa 
the  product  ions  output  increaaed.  This  waa  evidenced  by 
the  negative  growth  trend  in  predictions  with  the  reduced 
model  aa  tlie  predictive  time  span  was  increaaed  within 
each  situation.  That  the  introduction  of  the  production 
rate  variable  of  the  full  model  stabilized  thia  trend  in 
approziaately  half  of  the  test  situationa  and  reduced 
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tl)y»  tx«sd't  •eT«xit7  iA  remaining  situatlozia  was 
&otawoxtl7» 

Otbas  f iMlaga  related,  to  predlotlre  abilitj  were 
obaeirred*  Slrst,  zu  dear  advastage  in  performaace  was 
demonstrated  bj  either  prodactl^  rate  variable  pror^r. 
Second  no  performance  advantage  was  aacertained  for  any 
of  the  three  labor  hoar  categories.  The  results  were  not 
markedly  better  for  either  of  the  production  rate  proxies 
or  within  any  of  the  three  labor  hotir  categories. 


Cluster  3 

SnWTiHr  ASD  CaSCLOSlGSS 

Qa*  ▼•X7  ioQortazit  aspect  o£  acqiiiriiig  new  air- 
craft weapon  STStema  la  the  need  to  accuratelj  eatimate 
their  prodoctlon  coata.  If  such  costs  could  be  accurately 
eatinated,  budgets  could  be  more  firmly  set,  cost  trade- 
off analyaia  between  acquisition  of  different  weapon 
•ystema  could  be  more  hearily  relied  upon^  and  the 
eabaraasment  of  extensive  cost  overruns  could  be  averted. 
VIhile  the  need  for  accurate  estimates  is  readily  evident, 
reliable  estimating  techniques  are  not  easily  derived. 

Perhaps  the  first  step  in  solving  the  problem 
is  to  examine  individual  cost  components  one  at  a time. 

One  such  component  is  the  cost  of  direct  labor  required 
to  manufacture  each  aircraft,  and  considerable  research 
has  been  conducted  concerning  these  labor  requirements. 

One  particular  area  of  research  focused  on  the  por^ 
tlon  of  aircraft  labor  irequirements  needed  to  fabricate 
and  assemble  the  aircraft's  airframe,  including  the 
installation,  but  not  the  manizfacture , of  avionics  and 
other  add-on  equipment.  This  later  research  area  defines 
the  portion  of  the  aircraft  cost  estimating  problem  that 
was  examined  in  this  study. 
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PBEVIOUS  ESTIKA^CIITG  TECBSiqUES  ASB  BESEARCH 

X tiaditiaaal  approach,  to  eatifflatlng  direct  labor 
reqialreneata  is.  airframe  production  has  involved  tbe  use 
of  tba  standard  learning  curve  model..  Specif icall7, 
variations  in  direct  labor  requirements  were  assumed  to 
be  driven  onl7  by  the  cumulative  output  of  produced  air» 
frames.  While  this  standard  model  has  had  widespread 
acceptance  in  the  aircraft  industry  and  in  the  Dop^  the 
need  for  ia^roving  the  model  lias  also  be^  widely  accepted. 

One  area  for  possible  io^rovement  is  to  Include 
the  rate  of  production,  in  addition  to  the  already  proven 
cumulative  output,  as  an  erplainer  of  labor  hour  require- 
ment variations.  While  the  standard  model  is^licitly 
assumes  that  production  rate  will  increase  as  output 
increases  if  the  available  labor  time  is  held  constant, 
it  does  not  systematically  consider  the  impact  of  explicit 
production  rate  changes  that  could  be  dictated  by  forces 
external  to  the  learning  process. 

Considerable  research  effort  has  been  expended 
in  developing  models  that  consider  the  effect  of  eo^licit 
production  rate  changes,  Bbwever,  based  on  avaiilable 
literature , the  research  efforts  reported  in  Chapter  2 
showed  an  evolution  of  new  models  that  held  promise  for 
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as 
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conttnued  derelopmeat.  la  particular,  Solth's  model  and 
reaearch  approach  were  deemed  worth7  of  Talldatlon  and 
replication* 


Hla  approach  waa  to  modif^r  the  standard  learning 
curve  model  hj  including  a production  rate  variable  in 
mnltiplicative  form.  The  resulting  model  in  general 

form  is  T • ? where: 

T represents  the  unit  average  direct  labor  hours  per 
pound  of  airframe, 

represents  the  cumulative  output  as  in  the  stan* 
dard  model, 

Z2  represents  the  production  rate, 
c represents  the  statistical  error  term,,  and 
Bq,  B>j,  and  B2  are  regression  coefficients. 

TTaing  this  modified  model,  he  examined  production  data 
for  the  P-h,  1-102,  and  EC-135- 

HESEARCH  0BJECTI7ES  ABB  KETBOBOLOGT 

The  primary  objective  of  this  research  was  to 
identify  the  impact  of  production  rate  changes  on  the 
T-38/P-3  program  using  Smith's  model  and  research 
approach.  A.  second  objective  of  validating  Smith's 
model  and  approach  was  also  achieved. 

In  order  to  evaluate  the  I-3S/P-3  production 
program  %rith  Smith's  model,  several  combinations  of  data 
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were  deyiaed  within  the  full  set  of  data.  Tire  basic 
coQbtnatlona  o£  aicfzame  models  were  used  to 
cusozlatire  output  and  prodaction  rate  variables.  The 
first  two  combinations  were  essantiallj  equivalent  to 
the  data  combinations  that  Smxth  used  in.  his  research. 

Within,  each  basic  combination,  the  three  labor  hour 
categories  (total,  fabrication,  and  assemblj)  were 
examined  using  each  production  rate  pro:^  (manufacturing 
and  delivei7).  This  provided  a total  of  30  data  set 
teat  situations  for  which  the  tliree  research  hypotheses 
were  evaluated. 

The  method  of  analysis  'called  for  regression  of  ^ 

each  data  set  in  order  to  evaluate  each  statistical  hypoth- 
esis devised  in  support  of  the  research  hypotheses. 

Specifically,  Research  Qrpotheses  One  and  Two  required 
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regression  to  obtain  the  R values  and  R statistics 
needed  to  determine  the  overall  significance  of  the  pro- 
duction rate  variable.  The  model's  B2  regression  coef- 
ficient was  used  to  determine  whether  the  production 
rate  variable  was  positively  or  negatively  correlated 
with  labor  hour  variations.  Knally,  the  regression 
coefficients  for  pozrtions  of  the  data  in  each  test 
situation  were  needed  to  permit  predictive  ability 
testing. 


COHCLOSIOHS  j 

An  ovarwiieliBins  majority  of  th.e  rtndl.ngs  in  tliia  i 

: 

researdi  directly  stop port  tiie  conclusions  drawn  by  Smith.. 

In  a few  instances,  however,  his  conclusions  require 
modification  before  they  can  be  supported.  In  this 
context,  the  following  discussion  interprets  the  findings 
of  this  research  as  they  relate  to  Smith's  conclusions. 

Smith's  First  Conclusion 

Smith's  first  conclusion  that  there  is  a negative 
correlation  between  production  rate  and  direct  labor 
requirements  is  directly  supported  by  the  findings. 

Specifically,  the  B2  coefficients  axe  negative  in  every 
situation  tested.  This  negative  correlation  indicates 
that  if  production  rate  is  increased,  the  required  labor 
hours  per  pound  of  airframe  will  decrease.  Therefore, 
the  findings  in  this  research  support  and  further 
validate  his  conclusion. 

Smith's  Second  Conclusion 

Smith's  second  concltision  was  that  both  produc- 
tion rate  proxies  were  important  explainers  of  labor 

hour  variations,  and  that  the  full  model  with  manufac- 
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tuorijag  rate  gave  higher  R results  than  the  full  model 


with  delirexy  rate.  !I!he  first  part  of  this  conclusion  is 

strangle  supported  hj  findings  in  this  research*  The 

production  rate  Tariahle  was  found  to  he  statisticallT' 

significant  for  all  labor  hour  categories  and  production 

rate  prosQr  combinations  under  Xest  Situations  1 and  2. 

2 

The  R values  in  these  test  situations  for  total  and 
fabrication  labor  hour  categories  are  hi^er  for  the 

manufacturing  rate  than  for  the  deliver7  rate.  Bbwever, 

2 

under  the  assemblT^  hours  category,  the  delivery  rate  B 

values  are  slightly  higher.  So,  the  second  part  of  his 

conclusion  is  only  supported  for  total  and  fabrication 

labor  houis  in  these  test  situations. 

In  the  remaining  test  situations  (3,  and  3)t 

for  which  Smith  developed  no  equivailents , his  second 

conclusion  is  also  only  partially  supported.  In  these 

situations,  where  only  certain  airframe  models  were 

examined,  the  production  rate  variable  was  statistically 

significant  in  all  but  one  situation  C3ili)  at  the  pre> 

specified  0.03  level  of  significance.  This  finding 

gives  q^lite  strong  support  to  the  first  part  of  his 

second  conclusion.  However,  in  these  situations  the 
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delivery  rate  gave:  hi^er  B values  in  nine  out  of  ten 
situations,  which  does  not  support  the  second  peirt  of 
his  concltision.  Still,  based  on  all  the  findings  for 


all  teat  situations,  it  can  be  concluded  that  both  pro- 
duction rate  proxies  are  sisniXicant  explainers  of  labor 
hour  rariatlons  for  each  airframe  model  as  well  as  labor 
hour  variations  for.  all  models  combined. 

Smith’s  !Chird  Conclusion 

Smith's  third  conclusion  was  that  con^arison  of 
values  for  the  full  and  reduced  models  indicated  that 
the  full  model  fit  the  data  better  than  the  reduced  model. 
The  results  for  all  permutations  of  Test  Situations  1 and 

p 

2 again  directl7  support  this  conclusion.  The  vadues 
obtained  for  the  full  model  with  both  production  rate 
proxies  were  hi^er  than  those*  obtained  with  the  reduced 
model. 

In  Test  Situations  3t  and  3 the  conclusion  was 

p 

also  supported,  but  in  one  situation  C5AK)  the  R (actual) 
value  was  higher  for  the  reduced  model  by  less  than  one 
percent.  However,  even  in  these  situations  where  only 
selected  airframe  models  were  examined,  support  for  the 
conclusion  is  stroxig. 

Smith's  Pourth  Conclusion 

Smith's  fourth  conclusion  was  that  the  full 
model  oqplained  fabrication  labor  hour  variations  more 
fully  than  assembly  labor  hour  variations.  However, 
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bi^ed  osL  a coopaxisoa  ot  the  values  derived  ia.  this 

research.^  the  opposite  couclusloa  nust  be  drawn*  7or 

lest  Situations  1 axui  2 the  full  model  with  manufacturing 

2 

rate  gave  sll^tlT*  higher  £ values  under  the  assemblj 

cate^zy,  and  much  higher  values  for  assembly  with 

the  dellvezy  rate  proi^.  Further,  with  the  exception 

2 

of  situations  3^511  and  5AK,  a comparison  of  £ values  in 
(Cest  Situations  3i  and  5 shows  that  assemblj  labor 
hours  are  more  fully  explained. 

a!he  ramification  of  these  flxidings  is  that 
assembly  labor  hour  requirem^ts  may  be  more  sensitive 
than  fabrication  labor  hotir  requirements  to  production 
rate  changes.  Eowever,  in  light  of  Smith's  findings 
which  led  to  the  opposite  conclusion,  pezhaps  the  only 
logical  cosqpromlse  is  that  while  both  fabrication  and 
assembly  labor  liour  reqTiirements  are  sensitive  to 
production  rate,  no  firm  conclusion  can  be  drawn  as  to 
which  Is  more  sensitive. 

Smith's  Fifth  Conclusion 

Smith's  fifth  conclusion  was  that  the  production 
rate  variable  stabilized  and  In^roved  the  predictive 
ability  of  the  full  model.  (Z3ie  predictive  ability 
results  of  the  full  model,  as  measured  by  percentage 
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i 
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deTlation  from  o'baerred  values , were  not  as  consistentlj 
good  as  the  results  that  Smith  found  in  his  research. 
However » the  full  model's  predictions  were  suhstantiallj 
better  and  more  stable  over  a broader  predictive  time 
span  range  than  the  predictions  gLvw.  bj  the  reduced 
model.  In  particular,  the  one  year  predictions  of  the 
full  model  for  Teat  Situations  1 and  2 deviated  by 
approximately  five  percent  or  less  in  nine  out  of  twelve 
instazLces.  In  situation  STM  the  deviation  was  -10.5* 
in  it  was  10.6,  and  for  2HD  it  was  ->13.0  parent. 

To  put  these  deviations  in  perspective,  however,  the 
reduced  model  deviations  were  -14,0  percent,  -14.6  per- 
cent axid  -26.8  percent,  respectively,  for  these  same 
situations.  In  Test  Situations  and  3 only  seven 

of  the  twenty  predictions  fell  within  the  five  percent 
deviation  limit.  Again,  however,  in  18  of  these  situa- 
tions the  full  model  predictions  were  as  good  as  or 
better  then  those  of  the  reduced  model. 

So,  while  the  predictive  ability  of  the  full 
model  was  not  good  enough  to  pass  the  arbitrarily 
selected  five  percent  deviation  criterion  in  all  cases, 
it  was  substantially  better  than  the  reduced  model's 
ability  in  the  vast  majority  of  situations  tested.  Hot 
only  were  the  predictions  better,  they  were  more  stable 


over  a viider  predictive  time  span.  These  findings,  them, 
are  supportive  o£  Smith's  fifth  conclusion. 


Smith's  Sixth  Conclusion 


Smith's  sixth  azid  final  conclusion  was  that 


trying  to  formulate  a generalised  cost  model  using  coef- 
ficients obtained  from  various  production  programs  should 
not  he  attempted.  Support  for  this  conclusion  was  foimd 
within  the  predictive  ability  test  sittiations  with  no 
need  to  compare  T--38/P-3  results  against  Smith's 
7-102,  and  EC-135  results.  7or  instance,  the  regression 
coefficients  often  changed  substantially  within  a given 
test  situation  as  successive  cases  were  omitted  from 


the  regressed  data.  This  finding  strongly  supports  his 
conclusion  that  coefficients  shotild  not  be  averaged 
between  or  even  within  production  programs.  The  model 
coefficients  must  be  tailored  through  regression  analysis 
of  the  most  current  data  available  for  a given  program. 


CLOSING  HEUABES  ML  SECOKIIMLATIONS 


The  ob;]ectives  of  this  research  were  success- 
fully achieved.  In  particular,  the  impact  of  the  pro- 
duction rate  on  direct  labor  requirements  was  analyzed 
in  detail  and  found  to  be  substantial.  Secondly, 
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'because  of  tbis  first  achieTeiaeut , furtber  support  and 
validation  of  Smith's  model  and  approach  were  shown. 

'Bfr  combining  the  results  of  this  research  with 
those  of  Smith's  research,  the  applicabilitj  of  his  model 
and  approach  haTe  been  successfully  demonstrated  for 
three  filter  aircraft  of  different  size,  weight,  and 
performance  capability.  Additionally,  Smith's  limited 
success  in  applying  the  model  to  the  program 

implies  an  even  broader  range  of  applicability. 

]7ot  only  do  these  four  aircraft  programs  demon- 
strate  applicability  of  Smith's  model  to  different  air- 
craft types,  they  also  represent  applicability  to  the 
production  techniques  and  strategies  of  different  manu- 
facturers. This  lends  added  support  to  the  proposal 
that  production  rate  effects  are  indeed  an  important 
consideration  when  estimating  labor  requirements. 

Finally,  it  is  recommended  that  Smith's  model 
and  approach  be  used  to  forecast  direct  labor  require- 
ments for  future  production  of  airframes  in  an  active 
production  program.  The  consistency  of  research  results 
indicates  the  model's  potential  reliability  and  worth  to 
estimators  in  such  an  application. 


9' 
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Regression  Analysis  Variables  For  Test  Situation 
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Regression  Analysis  Variables  Por  Test  Situation  4 
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Regreasion  Analyala  Vaciablea  Foe  Teat  Situation 
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Table  23  (Continued) 


Tabl*  24 


Vttdietiv*  Ability  • T«st  Situation  ITM/ITD 


Seduced 

Modal  - iTM/lTD 

— 

Casas 

Bl 

82  Forecast* 

t 

Deviation 

30 

aasfcad 

aaskad 

--  1*94 

-6.7 

36 

— 1.83 

-12.0 

34* 

— 1.77 

-14.9 

32 

— 1.73 

-16.8 

30 

— 1.67 

-19.7 

28 

— 1.63 

-21.6 

V 

Full 

Modal  • ITM 

Casas 

Bo 

Bl 

B2  Forecast* 

t 

Deviation 

38 

aaskad 

aaskad 

aaskad  2.16 

3.8 

36 

^.19 

5.3 

34* 

2.19 

5.3 

32 

2.24 

7.7 

30 

*'2,22 

6.7 

28 

2.22 

6.7 

Full 

Modal  • ITD 

Casas 

Bo 

Bl 

82  Forecast* 

% 

Deviation 

38 

aaskad 

aaskad 

aaskad  2.14 

2.9 

36 

2.12 

1.9 

34* 

2.06 

-1.0 

32 

2.02 

-2.9 

30 

2.01 

-3.4 

28 

1.99 

-4.3 

^roracasta  ara  aada  foe  tba  labor  hours  variable 
in  Lot  f40  (Casa  40)  for  which  tba  observed  value  is 
2.00  hours  par  pound. 


* - Indicates  approxiaata  one  year  tiaa  span. 


110 


1 


Table  25 

Predictive  Ability  * Test  Situation  IFM/lfO 


• 

Bedueed 

Model 

IFM/IFD 

Caaea 

»0 

>1 

»2 

Fotecaat* 

% 

Deviation 

38 

■naked 

■naked 

... 

1.11 

-9.8 

36 

1.08 

-12.2 

34* 

1.05 

-14.6 

32 

— 

1.01 

-17.9 

30 

0.96 

-22.0 

28 

0.93 

-24.0 

Full 

Model  - 

IFM 

Caaea 

*0 

Forecaat* 

« 

Deviation 

38 

■naked 

■naked 

■naked 

1.34 

8.9 

36 

1.36 

10.6 

34* 

1.36 

10.6 

32 

1.3*9 

13.0 

30 

1.36 

10.6 

28 

1.30 

5.7 

Full 

Model  • 

IFD 

Caaea 

■o 

»2 

Forecaat* 

% 

Deviation 

38 

■naked 

■naked 

■naked 

1.30 

5.7 

36 

1.28 

4.1 

34* 

1.24 

0.8 

32 

1.20 

-2.4 

30 

1.17 

-4.9 

28 

1.11 

-9.8 

^Forecaats  are  aade  for  the  labor  hour a variable 
in  Lot  #40  (Caae  40}  for  which  the  obaerved  value  ia 
1.23  hour a per  pound. 

* o Zndicatea  approxiaate  one  year  tine  apan. 
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Tabl«  26 


Prvdlctlv*  Ability  Test.  Situation  lAM/lAO 


Badoead 

Modal  * 

lAM/lAO 

Casas 

“o 

•i 

“2 

Forecast^ 

% 

Deviation 

38 

oaskad 

oaskad 

8.75 

-11.8 

36 

0.74 

-12.9 

34* 

— 

0.73 

-14.1 

32 

— ■ 

0.72 

-15.3 

30 

— 

0.71 

-16.5 

28 

•• 

0.71 

-16.5 

ruu 

Modal  • 

1AM 

Casas 

■o 

®2 

Forecast^ 

% 

Deviation 

38 

oaskad 

oaskad 

oaskad 

0.83 

-2.4 

36 

0.83 

-2.4 

34* 

0.83 

-2.4 

32 

0.86 

1.2 

30 

0.87 

2.4 

28 

0.92 

8.2 

Pull 

Modal  - 

lAO 

Casas 

•o 

*1 

*2 

Forecast^ 

% 

Deviation 

38 

oaskad 

oaskad 

oaskad 

0.83 

-2.4 

36 

0.83 

-2.4 

34* 

0.82 

-3.5 

32 

0.82 

-3.5 

30 

0.84 

-1.2 

28 

0.87 

2.4 

*roraeatta  ara  oada  foe  tba  labor  hours  variable 
in  Lot  #4S  (Casa  40)  for  which  tha  obsarvad  value  is 
0.8S  hours  par  pound. 

* - Indicates  approxiaata  one  year  tine  span. 
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Table  27 

Pcadletiva  Ability  - Test  Sitnation  2TM/2TO 


Beduced 

Model  • 

2TM/2TD 

Cases 

«0 

Bl 

B2 

Porecast* 

% 

Deviation 

37 

masked 

aasked 

1.83 

-8.5 

35 

— 

1.77 

-11.5 

33* 

— 

1.72 

-14.0 

31 

1.69 

-15.5 

29 

1.63 

-18.5 

27 

•• 

1.61 

-19.5 

Pull 

Model  • 

2TM 

Cases 

®o 

Bl 

B2 

Porecast^ 

t 

Deviation 

37 

aasked 

aasked 

aasked 

2.16 

8.0 

35 

2.16 

8.0 

33* 

2.21 

10.5 

31 

2.24 

12.0 

29 

2.15 

7.5 

27 

2.19 

9.5 

Pull 

Model  - 

2TO 

Cases 

®0 

Bl 

B2 

Forecast^ 

% 

Deviation 

37 

Basked 

aasked 

aasked 

2.10 

5.0 

35 

2.05 

2.5 

33* 

2.01 

0.5 

31 

2.03 

1.5 

29 

1.95 

-2.5 

27 

1.95 

-2.5 

^Pocaeasta  aca  oada  foe  tba  labor^ hours  variable 
in  Lot  #40  (Casa  39)  for  which  the  observed  value  is 
2.00  hours  per  pound. 

* - Indicates  approxiaate  one  year  tiae  span. 
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Table  28 


ffcadlctlva  Ability  Tasb  Situation  2FM/2PD 


Seduced  Model 

2PM/2FD 

Casen 

Bl 

Bl 

Forecast* 

% 

Deviation 

37 

■asked 

■asked 

— 

1.08 

-21.0 

35 

1.05 

-23.9 

33* 

— • 

1.01 

-26.8 

31 

— 

0.88 

-29.0 

28 

0.83 

-32.6 

27 

•• 

0.90 

-34.8 

Pull 

Model  - 

2FM 

Cases 

Bq 

H 

Bl 

Forecast* 

% 

Deviation 

37 

■asked. 

■asked 

■asked 

1.35 

-2.2 

35 

1.35 

-2.2 

35* 

1.39 

0.7 

31 

1.38 

0.0 

28 

1.29 

-6.5 

27 

1.26 

-8.7 

Pull 

Model  • 

2FD 

Cases 

Bq 

Bl 

Bl 

Forecast* 

% 

Deviation 

37 

■asked 

■asked 

■asked 

1.29 

-6.5 

35 

1.25 

-9.4 

33* 

1.20 

-13.0 

31 

1.18 

-14.5 

28 

1.11 

-19.6 

27 

1.07 

-22.5 

*Foracaata  are  aad«  foe  tba  labor  hours  variable 
in  Lot  #48  (Case  38)  for  which  the  observed  value  is 
1.38  hours  per  pound. 

* - Indicates  approzinate  one  year  tine  span. 


Table  29 


Pradlctlva  Ability  Teat  Situation  2AM/2AO 


Seduced 

Model  * 

2AM/2AO 

Cases 

“o 

h 

=2 

Forecast* 

t 

Deviation 

37 

nasked 

nasked 

0.74 

-7.5 

35 

— 

0.72 

-10.0 

33* 

— 

0.71 

-11.3 

31 

— 

0.71 

-11.3 

29 

0.70 

-12.5 

27 

•• 

0.71 

-11.3 

Full 

Model  • 

2AM 

» 

Cases 

“o 

v 

=2 

Forecast* 

t 

Deviation 

37 

masked 

nasked 

nasked 

0.81 

1.3 

35 

0.81 

1.3 

33* 

0.83 

3.8 

31 

0.89 

11.3 

29 

0.87 

8.8 

27 

0.94 

17.5 

Full 

Model  - 

2AO 

Cases 

*0 

*1 

»2 

Forecast* 

% 

Deviation 

37 

nasked 

nasked 

nasked 

0.81 

1.3 

35 

0.80 

0.0 

33* 

0.80 

0.0 

31 

0.83 

3.8 

29 

0.84 

5.0 

27 

0.87 

8.8 

*foracaata  are  aada  for  the  labor  hours  variable 
in  Lot  #40  (Case  39)  for  which  the  observed  value  is 
0.80  hours  per  pound. 

* • Indicates  approzioate  one  year  tine  span. 
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Mucttd  Model  - 3TM/3TD 


Cases 

“0 

®2 

Forecast* 

t 

Deviation 

34 

masked 

masked 

1.67 

-11.2 

32 

— 

1.63 

-13.3 

3B* 

— 

1.59 

-15.4 

28 

— 

1.56 

-17.0 

26 

— ■ 

1.54 

-18.1 

24 

““ 

1.54 

-18.1 

Full 

Model  - 

3TM 

Cases 

«0 

®1 

®2 

Forecast* 

% 

Deviation 

34 

masked 

masked 

masked 

2.06 

9.6 

32 

2.00 

6.4 

38* 

1.94 

3.2 

28 

1.88 

0.0 

26 

1.86 

-1.1 

24 

1.88 

0.0 

Pull  Model  - 3TD 

Cases  Bq  B2  Forecast*  t Deviation 

34  masked  masked  masked  1.91 


1.6 


Tmbl*  31 


Pradietlvtt  Ability  • TMt  Situation  3FM/3PO 


Raduead 

Modal  - 

3PM/3PD 

Casas 

80 

«1 

Foracast^ 

% 

Dawiation 

34 

■askad 

oaskad 

... 

0.99 

-13.2 

32 

0.96 

-15.8 

30* 

0.93 

-18.4 

28 

— 

0.89 

-21.9 

26 

0.87 

-23.7 

24 

0.87 

-23.7 

Pull 

Modal  - 

3FM 

Casas 

*0 

*2 

Foracast^ 

t 

Daviation 

34 

oaskad 

oaskad 

oaskad 

1.36 

19.3 

32 

1.34 

17.5 

30* 

1.27 

11.4 

28 

1.22 

7.0 

26 

1.16 

1.8 

24 

1.22 

7.0 

Full 

Modal  ~ 

3FD 

Casas 

®0 

®1 

»2 

Foracast* 

% 

Daviation 

34 

•askad 

oaskad 

oaskad 

1.17 

2.6 

32 

1.11 

-2.6 

30* 

1.05 

-7.9 

28 

0.99 

-13.2 

26 

1.01 

-11.4 

24 

1.00 

-12.3 

*Foraeasta  act  aada  for  tba  labor  boars  variabla 
in  Lot  #4f  (Caso  36)  for  which  tha  obsorwad  walua  is 
1.14  hours  par  pound. 

* - Indies tas  approx iaata  ona  yaar  tiaa  span. 
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Table  32 


Pradictlve  Ability  - Taat  Situation  3AM/3AO 


Seduced 

Model 

3AM/3AO 

Cases 

*0 

“2 

Forecast* 

% 

Deviation 

34 

■asked 

■asked 

0.68 

-8.1 

32 

— 

0.67 

-9.5 

3a* 

— ■ 

0.67 

-9.5 

28 

— 

0.67 

-9.5 

26 

— 

0.68 

-8.1 

24 

•• 

0.68 

-8.1 

Pull 

Model  - 

3AM 

Cases 

■o 

Forecast^ 

% 

Deviation 

34 

■asked 

■asked 

■asked 

0.74 

0.0 

32 

0.70 

-5.4 

3f* 

0.69 

-6.8 

28 

0.69 

-6.8 

26 

0.73 

-1.4 

24 

0.73 

-1.4 

Full 

Model  - 

3A0 

Cases 

“o 

*2 

Forecast* 

% 

Deviation 

34 

■asked 

■asked 

■asked 

0.74 

0.0 

32 

0.71 

-4.1 

38* 

0.71 

-4.1 

28 

0.72 

-2.7 

26 

0.74 

0.0 

24 

0.75 

1.4 

*foraeaata  are  aada  for  tba  labor  hours  variable 
in  Lot  #41  (Case  36)  for  which  the  observed  value  is 
f.74  hours  per  pound. 

* - Indicates  approxioate  one  year  tine  span. 


Table  33 


Predictive  Ability  • Teat  Situation  4TN/4TD 


Reduced  Model 

4TM/4TD 

Cases 

®0 

Porecast^ 

% 

Deviation 

23 

masked 

masked 

2.08 

-5.9 

21 

— 

2.06 

-6.8 

19* 

— 

1.97 

-10.9 

17 

1.88 

-14.9 

15 

1.78 

-19.5 

13 

•• 

1.71 

-22.6 

Pull 

Model  - 

4TM 

Cases 

*0 

Porecast^ 

t 

Deviation 

23 

masked 

masked 

masked 

2.09 

-5.4 

21 

2.07 

-6.3 

19* 

2.03 

-8.1 

17 

2.00 

-9.5 

15 

1.90 

-14.0 

13 

1.85 

-16.3 

Pull 

Model  - 

4TD 

• 

Cases 

•o 

Porecast* 

% 

Deviation 

23 

masked 

masked 

masked 

2.35 

6.3 

21 

2.30 

4.1 

19* 

2.23 

0.9 

17 

2.19 

-0.9 

15 

2.18 

-1.4 

13 

2.10 

-5.0 

*Porecasta  are  made  foe  the  labor  hours  variable 
in  Lot  #40  (Case  25)  for  which  the  observed  value  is 
2.21  hours  per  pound. 

* - Indicates  approximate  one  year  time  span. 
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Tabl«  34 


Pradictivtt  Ability  • Test  Situation  4FM/4FO 


Seduced 

Model  - 

4FM/4FO 

' Cases 

»0 

®2 

Forecast* 

4 

Deviation 

23 

aasked 

aasked 

1.35 

5.5 

21 

— 

1.33 

3.9 

19* 

1.29 

0.8 

17 

— ■ 

1.22 

-4.7 

15 

1.17 

-8.6 

13 

•• 

1.11 

-13.3 

Full 

Model  *• 

4FM 

Cases 

®2 

Forecast* 

% 

Deviation 

23 

aasked 

aasked 

aasked 

1.35 

5.5 

21 

1.34 

4.7 

19* 

1.32 

3.1 

17' 

1.28 

0.0 

15 

1.20 

-6.3 

13 

1.14 

-10.9 

Full 

Model  • 

4FD 

Cases 

*0 

®2 

Forecast* 

% 

Deviation 

23 

aasked 

masked 

aasked 

1.34 

4.7 

21 

1.32 

3.1 

19* 

1.28 

0.0 

17 

1.26 

-1.6 

15 

1.22 

-4.7 

13 

1.17 

-8.6 

*Foracaats  aca  made  for  the  labor  hours  variable 
In  Lot  #40  (Case  25)  for  which  the  observed  value  Is 


Tmbl«  3S 


, f 
I 

( ; 


Pradietiv*  Ability  •>  Taat  Situation  4AM/4AO 


Raduead 

Modal  • 4AM/4AO 

Casas 

“o 

82  Forecast^ 

% 

Deviation 

23 

■askad 

■askad 

— 0.76 

-17.4 

21 

— 0.75 

-18.5 

19* 

— 0.73 

-20.7 

17 

— 0.69 

-25.0 

15 

— 0.66 

-28.3 

13 

~ 0.66 

-28.3 

Full 

Model  - 4AM 

Casas 

*0 

Forecast* 

t 

Deviation 

23 

ouiakad 

■askad 

■asked  0.77 

-16.3 

0 

21 

0.76 

-17.4 

19* 

0.75 

-18.5 

17 

0.74 

-19.6 

15 

0.71 

-22.8 

j 

13 

0.72 

-21.7 

j 

Full 

Modal  - 4AO 

fc 

Casas 

•0 

»1 

82  Forecast* 

% Deviation 

! 

23 

■asked 

■askad 

■asked  0.75 

-18.5 

[ 

21 

0.75 

-18.5 

' 

: 

19* 

0.72 

-21.7 

i 

17 

0.72 

-21.7 

15 

0.72 

-21.7 

13 

0.73 

-20.7 

*Poracaats  are  aada  foe  tba  labor  hours  var labia 
in  Lot  #40  (Casa  25)  for  which  tha  obsarwad  walua  is 
0.92  hours  par  pound. 

* * Indieatas  approxiaata  ona  yaar  tiaa  span. 
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Table  36 

PradietiTa  Ability  • Test  Situation  5TM/5TO 


Reduced  Nodal  ** 

5TN/5TD 

Caaaa 

®0 

h 

*2 

Foracaat^ 

t 

Deviation 

22 

■aakad 

■aakad 

2.11 

-8.3 

20 

— 

2.06 

-10.4 

18^ 

1.98 

-13.9 

16 

1.89 

-17.8 

14 

1.79 

-22.2 

12 

•• 

1.75 

-23.9 

flu 

Nodal  ** 

STN 

Caaaa 

®1 

»2 

Forecaat* 

% 

Deviation 

22 

oaakad 

■aakad 

■aakad 

2.49 

8.3 

20 

2.43 

5.7 

18* 

2.40 

4.3 

16 

2.27 

-1.3 

14 

2.14 

-7.0 

12 

2.14 

-7.0 

Full 

Nodal  ~ 

STD 

Caaaa 

h 

»2 

Foracaat* 

% 

Deviation 

22 

■aakad 

■aakad 

■aakad 

2.44 

6.1 

20 

2.37 

3.0 

18* 

2.34 

1.7 

16 

2.36 

2.6 

14 

2.17 

-5.7 

12 

2.13 

-7.4 

^Foracaata  aca  mada  foe  tha  labor  hour a variable 
in  tot  t40  (Caaa  24)  for  which  tha  obaarvad  value  ia 
2.30  houra  par  pound. 


* - Indicataa  approzinata  one  year  time  apan. 

1 


Table  37 

Ptadietiva  Ability  • Taat  Situation  5PM/5PD 


i 


Baducad  Modal  - 

5FM/5FO 

^mmm 

Casas 

•o 

•i 

»2 

Forecast^ 

t 

Deviation 

22 

aaskad 

aaskad 

1.36 

1.5 

2S 

1.33 

-0.7 

la* 

— 

1.28 

-4.5 

Id 

1.22 

-9.0 

14 

~ 

1.14 

-14.9 

12 

•• 

1.10 

-17.9 

Full 

Modal  > 

SFM 

Casas 

*0 

h 

■2 

Forecast* 

% 

Deviation 

22 

aaskad 

aaskad 

aaskad 

1.50 

18.7 

20 

1.56 

16.4 

18* 

1.51 

12.7 

16 

1.40 

4.5 

14 

1.29 

-3.7 

12 

1.20 

-10.4 

Full 

Modal  - 

5F0 

Casas 

“o 

»2 

Forecast* 

t 

Deviation 

22 

aaskad 

aaskad 

aaskad 

1.55 

15.7 

28 

1.51 

12.7 

18* 

1.47 

9.7 

16 

1.42 

6.0 

14 

1.28 

-4.5 

12 

1.24 

-7.5 

*Peraeaats  aca  aaSa  foe  tba  labor  boars  variabla 
in  Lot  I4f  (Casa  24)  for  which  tba  obsarwad  value  is 
1.34  hours  par  pound. 


* - Indicates  approaiamta  one  year  tiaa  span. 
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Table  38 


Pradictiy*  Ability  • Test  Situation  5AM/5AO 


Seduced 

Model  • 

5AM/5AO 

Caaea 

>0 

®1 

®2 

Forecast* 

% 

Deviation 

22 

aasked 

usked 

0.78 

-18.8 

20 

0.76 

-20.8 

18* 

— 

0.74 

-22.9 

16 

0.78 

-18.8 

14 

0.69 

-28.1 

12 

•• 

0.70 

-27.1 

Pull 

Model  - 

5AM 

Cases 

®0 

®2 

Forecast^ 

t 

Deviation 

22 

OMisked 

aasked 

aasked 

0.89 

-7.3 

20 

0.87 

-9.4 

18* 

0.88 

-8.3 

16 

• 

0.83 

-13.5 

14 

0.79 

-17.7 

12 

0.89 

-7.3 

Pull 

Model  ** 

5AO 

Cases 

"o 

*1 

*2 

Forecast* 

t 

Deviation 

22 

aasked 

aasked 

aasked 

0.88 

-8.3 

20 

0.86 

-10.4 

18* 

0.88 

-8.3 

16 

0.88 

-8.3 

14 

0.85 

-11.5 

12 

0.87 

-9.4 

*Poracaata  are  aada  foe  tba  laboe  hour a variable 
in  Lot  #40  (Caae  24)  foe  which  the  observed  value  is 
0.96  hours  per  pound. 

* - Indicates  approxiaate  one  year  tiae  span. 
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